Jul 20 19:54:26.240819 ip-10-0-132-157 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 19:54:26.240984 ip-10-0-132-157 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 19:54:26.240998 ip-10-0-132-157 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 19:54:26.241268 ip-10-0-132-157 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 19:54:36.383548 ip-10-0-132-157 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 19:54:36.383565 ip-10-0-132-157 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 95873d284bef4917a4e2ca11250ef30f -- Jul 20 19:56:31.700286 ip-10-0-132-157 systemd[1]: Starting Kubernetes Kubelet... Jul 20 19:56:32.097692 ip-10-0-132-157 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:56:32.097692 ip-10-0-132-157 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 19:56:32.097692 ip-10-0-132-157 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:56:32.097692 ip-10-0-132-157 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 19:56:32.097692 ip-10-0-132-157 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 19:56:32.098367 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.097744 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 19:56:32.104626 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104608 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:56:32.104626 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104626 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104631 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104634 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104637 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104640 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104644 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104647 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104650 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104653 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104655 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104658 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104660 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104662 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104665 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104667 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104670 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104673 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104676 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104678 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104681 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:56:32.104688 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104683 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104686 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104688 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104691 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104693 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104697 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104699 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104702 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104705 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104708 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104710 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104713 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104715 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104718 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104721 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104725 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104728 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104732 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104735 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:56:32.105199 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104737 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104740 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104742 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104744 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104747 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104749 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104752 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104755 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104757 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104759 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104762 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104764 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104766 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104768 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104771 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104774 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104777 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104781 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104785 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104788 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:56:32.105640 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104791 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104793 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104796 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104799 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104801 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104804 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104806 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104809 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104812 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104814 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104817 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104819 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104822 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104824 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104827 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104829 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104832 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104835 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104837 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:56:32.106221 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104840 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104842 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104844 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104847 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104849 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104851 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104853 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104856 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104861 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104865 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104868 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104870 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104873 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104875 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104878 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104880 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104882 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104885 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104887 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.104889 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:56:32.106651 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105589 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105595 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105598 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105601 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105603 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105606 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105609 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105611 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105613 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105616 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105618 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105620 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105623 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105625 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105627 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105630 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105632 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105634 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105637 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105639 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:56:32.107134 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105642 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105645 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105651 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105653 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105656 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105659 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105661 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105663 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105666 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105669 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105671 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105673 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105676 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105678 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105680 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105683 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105685 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105687 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105691 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:56:32.107635 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105693 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105695 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105698 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105700 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105703 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105706 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105708 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105710 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105713 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105715 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105718 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105720 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105722 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105725 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105727 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105730 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105732 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105734 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105737 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105739 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:56:32.108080 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105742 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105744 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105746 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105748 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105751 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105753 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105756 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105759 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105762 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105764 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105767 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105769 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105772 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105774 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105777 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105780 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105782 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105785 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105788 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105791 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:56:32.108546 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105793 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105796 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105798 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105800 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105804 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105809 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105812 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105814 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105817 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105820 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105823 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105825 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105828 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105831 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105833 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105836 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105838 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105841 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105843 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:56:32.109027 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.105847 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106215 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106220 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106223 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106226 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106229 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106232 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106237 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106240 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106243 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106246 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106249 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106253 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106257 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106260 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106263 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106266 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106268 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106271 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:56:32.109481 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106274 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106276 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106279 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106281 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106283 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106286 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106289 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106291 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106294 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106296 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106298 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106301 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106303 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106306 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106308 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106311 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106313 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106316 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106318 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106321 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:56:32.109927 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106325 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106327 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106330 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106332 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106335 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106338 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106340 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106342 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106345 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106347 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106349 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106352 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106355 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106357 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106360 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106362 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106364 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106367 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106369 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106372 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:56:32.110410 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106374 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106377 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106379 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106382 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106384 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106387 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106389 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106392 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106394 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106396 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106399 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106403 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106409 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106411 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106414 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106417 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106420 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106422 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106425 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:56:32.110873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106427 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106429 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106432 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106434 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106437 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106439 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106441 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106443 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106446 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106448 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106451 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106453 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106456 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106458 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106461 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106464 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106466 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106468 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106470 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106473 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:56:32.111338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106475 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.106477 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106544 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106550 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106556 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106562 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106566 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106569 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106573 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106577 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106580 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106583 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106586 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106588 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106604 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106608 2559 flags.go:64] FLAG: --cgroup-root="" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106612 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106616 2559 flags.go:64] FLAG: --client-ca-file="" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106618 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106621 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106626 2559 flags.go:64] FLAG: --cluster-domain="" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106628 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106631 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106634 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 19:56:32.111799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106637 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106641 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106644 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106647 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106650 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106653 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106655 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106659 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106661 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106664 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106668 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106671 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106674 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106678 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106680 2559 flags.go:64] FLAG: --enable-server="true" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106684 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106688 2559 flags.go:64] FLAG: --event-burst="100" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106691 2559 flags.go:64] FLAG: --event-qps="50" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106694 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106697 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106699 2559 flags.go:64] FLAG: --eviction-hard="" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106702 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106705 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106708 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106712 2559 flags.go:64] FLAG: --eviction-soft="" Jul 20 19:56:32.112383 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106715 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106717 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106720 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106722 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106725 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106728 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106730 2559 flags.go:64] FLAG: --feature-gates="" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106734 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106737 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106739 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106742 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106745 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106748 2559 flags.go:64] FLAG: --help="false" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106750 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106753 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106756 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106758 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106761 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106764 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106767 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106770 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106772 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106775 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 19:56:32.112974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106778 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106781 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106784 2559 flags.go:64] FLAG: --kube-reserved="" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106787 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106789 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106792 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106795 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106797 2559 flags.go:64] FLAG: --lock-file="" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106801 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106804 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106806 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106811 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106814 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106817 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106819 2559 flags.go:64] FLAG: --logging-format="text" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106822 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106826 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106828 2559 flags.go:64] FLAG: --manifest-url="" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106831 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106835 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106837 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106841 2559 flags.go:64] FLAG: --max-pods="110" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106844 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106846 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106849 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 19:56:32.113580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106852 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106855 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106857 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106860 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106866 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106869 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106872 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106874 2559 flags.go:64] FLAG: --pod-cidr="" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106880 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106885 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106888 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106891 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106894 2559 flags.go:64] FLAG: --port="10250" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106897 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106899 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ca618c4c30e8f4c1" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106903 2559 flags.go:64] FLAG: --qos-reserved="" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106906 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106909 2559 flags.go:64] FLAG: --register-node="true" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106911 2559 flags.go:64] FLAG: --register-with-taints="" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106915 2559 flags.go:64] FLAG: --registry-burst="10" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106917 2559 flags.go:64] FLAG: --registry-qps="5" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106920 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106922 2559 flags.go:64] FLAG: --reserved-memory="" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106926 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106929 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 19:56:32.114192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106931 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106934 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106937 2559 flags.go:64] FLAG: --runonce="false" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106939 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106942 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106945 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106947 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106950 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106953 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106956 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106959 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106961 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106964 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106967 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106969 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106972 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106975 2559 flags.go:64] FLAG: --system-cgroups="" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106977 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106982 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106985 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106987 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106991 2559 flags.go:64] FLAG: --tls-min-version="" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106994 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106997 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.106999 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 19:56:32.114786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.107002 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.107005 2559 flags.go:64] FLAG: --v="2" Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.107008 2559 flags.go:64] FLAG: --version="false" Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.107034 2559 flags.go:64] FLAG: --vmodule="" Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.107038 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.107041 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107170 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107174 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107178 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107181 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107183 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107186 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107188 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107191 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107193 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107195 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107198 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107200 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107202 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107206 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:56:32.115392 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107209 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107211 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107214 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107216 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107219 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107222 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107224 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107226 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107229 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107233 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107236 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107238 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107240 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107243 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107245 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107248 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107250 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107253 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107255 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107258 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:56:32.115863 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107260 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107262 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107265 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107267 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107269 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107272 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107274 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107276 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107279 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107281 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107284 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107287 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107289 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107292 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107294 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107297 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107299 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107302 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107304 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:56:32.116384 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107306 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107310 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107314 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107317 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107320 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107322 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107325 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107328 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107330 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107333 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107335 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107337 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107340 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107342 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107344 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107347 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107349 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107352 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107354 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:56:32.116837 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107356 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107358 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107361 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107363 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107365 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107369 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107371 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107373 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107376 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107378 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107380 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107383 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107385 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107388 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107390 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107393 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107397 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107400 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107403 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107405 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:56:32.117358 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107408 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107410 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107412 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107415 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107417 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107421 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.107424 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.108202 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.114945 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.114959 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.116454 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.116463 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116525 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116530 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116534 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:56:32.117836 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116537 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116540 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116545 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116548 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116551 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116555 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116559 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116562 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116564 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116567 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116569 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116572 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116575 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116577 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116580 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116582 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116585 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116587 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116589 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:56:32.118662 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116592 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116594 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116597 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116599 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116602 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116604 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116606 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116611 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116615 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116619 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116621 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116624 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116626 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116629 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116631 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116633 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116635 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116638 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116640 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116643 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:56:32.119421 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116645 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116648 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116650 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116652 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116655 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116657 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116659 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116662 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116664 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116667 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116669 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116672 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116674 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116677 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116679 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116682 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116685 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116687 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116690 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116692 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:56:32.120043 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116696 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116698 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116701 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116703 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116705 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116708 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116710 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116712 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116715 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116717 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116719 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116722 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116724 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116726 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116730 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116733 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116736 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116739 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116741 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:56:32.120557 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116744 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116746 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116748 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116751 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116753 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116756 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116759 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116761 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116764 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116766 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116768 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116771 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116773 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116775 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116783 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116786 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116788 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:56:32.120992 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116790 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.116795 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116950 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116958 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116961 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116964 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116966 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116969 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116971 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116975 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116978 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116981 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116984 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116986 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116989 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 19:56:32.121482 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116991 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116993 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116996 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.116998 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117001 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117003 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117005 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117007 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117026 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117030 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117033 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117035 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117038 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117040 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117042 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117051 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117053 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117056 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117058 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117061 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 20 19:56:32.121835 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117063 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117067 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117070 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117073 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117076 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117078 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117081 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117083 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117086 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117088 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117090 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117092 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117095 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117097 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117099 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117102 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117104 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117107 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117109 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117111 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 19:56:32.122323 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117114 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117116 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117119 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117121 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117124 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117126 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117128 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117130 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117138 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117141 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117144 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117147 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117150 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117153 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117155 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117157 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117160 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117162 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117164 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117166 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 19:56:32.122795 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117169 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117171 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117174 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117176 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117178 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117181 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117183 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117186 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117188 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117190 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117193 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117195 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117197 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117199 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117202 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117204 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117207 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117209 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117211 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 19:56:32.123273 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117214 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117216 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117224 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117226 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117229 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117231 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:32.117233 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.117238 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.117372 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.119722 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.121431 2559 server.go:1019] "Starting client certificate rotation" Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.121542 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:56:32.123703 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.121577 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 19:56:32.124054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.124038 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:56:32.125927 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.125914 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 19:56:32.137778 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.137759 2559 log.go:25] "Validated CRI v1 runtime API" Jul 20 19:56:32.139819 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.139804 2559 log.go:25] "Validated CRI v1 image API" Jul 20 19:56:32.140589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.140576 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 19:56:32.144730 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.144706 2559 fs.go:135] Filesystem UUIDs: map[186d196b-8586-43db-b497-e34067aa59bd:/dev/nvme0n1p4 3b6fe9c8-0ff7-4de2-84f5-9e21a0f3ba69:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 20 19:56:32.144818 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.144728 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 19:56:32.150050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.149916 2559 manager.go:216] Machine: {Timestamp:2026-07-20 19:56:32.148696365 +0000 UTC m=+0.332544088 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3209747 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23de5519a5717d131e5123e9c74460 SystemUUID:ec23de55-19a5-717d-131e-5123e9c74460 BootID:95873d28-4bef-4917-a4e2-ca11250ef30f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:a0:43:26:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:a0:43:26:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:4b:8e:1d:8e:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 19:56:32.150050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.150039 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 19:56:32.150199 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.150140 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 19:56:32.150569 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.150552 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:56:32.154218 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.154186 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 19:56:32.154360 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.154223 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-157.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 19:56:32.155275 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.155265 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 19:56:32.155313 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.155278 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 19:56:32.155313 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.155285 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:56:32.155906 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.155896 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 19:56:32.157241 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.157231 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 19:56:32.159745 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.159734 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:56:32.159869 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.159859 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 19:56:32.159905 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.159889 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 20 19:56:32.159905 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.159899 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 19:56:32.159964 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.159914 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 19:56:32.159964 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.159923 2559 kubelet.go:398] "Adding apiserver pod source" Jul 20 19:56:32.159964 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.159931 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 19:56:32.160296 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.160280 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:56:32.160358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.160300 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 19:56:32.164583 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.164565 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 19:56:32.166172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.166158 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 19:56:32.166223 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.166188 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 19:56:32.167070 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167059 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 19:56:32.167116 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167079 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 19:56:32.167116 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167086 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 19:56:32.167116 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167092 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 19:56:32.167116 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167100 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 19:56:32.167116 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167106 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 19:56:32.167116 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167114 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 19:56:32.167258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167119 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 19:56:32.167258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167126 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 19:56:32.167258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167132 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 19:56:32.167258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167140 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 19:56:32.167258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167146 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 19:56:32.167855 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167845 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 19:56:32.167889 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.167856 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 19:56:32.170315 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.170298 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-157.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 19:56:32.170837 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.170816 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 19:56:32.170886 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.170818 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 19:56:32.171178 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.171166 2559 server.go:1268] "Started kubelet" Jul 20 19:56:32.171294 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.171244 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 19:56:32.171363 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.171299 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 19:56:32.171407 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.171384 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 19:56:32.172051 ip-10-0-132-157 systemd[1]: Started Kubernetes Kubelet. Jul 20 19:56:32.172688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.172483 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bbfd" Jul 20 19:56:32.173041 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.173006 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 19:56:32.173483 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.173468 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 20 19:56:32.177097 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.177061 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 19:56:32.178720 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.178705 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 19:56:32.178797 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.178782 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.178842 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.178818 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 19:56:32.179370 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179353 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 19:56:32.179528 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179465 2559 factory.go:55] Registering systemd factory Jul 20 19:56:32.179602 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179540 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 19:56:32.179602 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179552 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 19:56:32.179686 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179586 2559 factory.go:223] Registration of the systemd container factory successfully Jul 20 19:56:32.179686 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179653 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 20 19:56:32.179686 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179661 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 20 19:56:32.179877 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179866 2559 factory.go:153] Registering CRI-O factory Jul 20 19:56:32.179915 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179880 2559 factory.go:223] Registration of the crio container factory successfully Jul 20 19:56:32.179948 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179927 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 19:56:32.179983 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179949 2559 factory.go:103] Registering Raw factory Jul 20 19:56:32.179983 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.179964 2559 manager.go:1196] Started watching for new ooms in manager Jul 20 19:56:32.180381 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.178760 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-157.ec2.internal.18c417aede8dba76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-157.ec2.internal,UID:ip-10-0-132-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-157.ec2.internal,},FirstTimestamp:2026-07-20 19:56:32.171137654 +0000 UTC m=+0.354985377,LastTimestamp:2026-07-20 19:56:32.171137654 +0000 UTC m=+0.354985377,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-157.ec2.internal,}" Jul 20 19:56:32.180490 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.180475 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bbfd" Jul 20 19:56:32.180586 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.180573 2559 manager.go:349] Starting recovery of all containers Jul 20 19:56:32.188886 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.188863 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:56:32.191297 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.191095 2559 manager.go:354] Recovery completed Jul 20 19:56:32.192597 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.192570 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-157.ec2.internal\" not found" node="ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.193085 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.193069 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 20 19:56:32.195909 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.195897 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:56:32.197852 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.197834 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:56:32.197924 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.197865 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:56:32.197924 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.197874 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:56:32.198408 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.198393 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 19:56:32.198471 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.198407 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 19:56:32.198471 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.198426 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 20 19:56:32.198471 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.198430 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:56:32.199484 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.199472 2559 policy_none.go:49] "None policy: Start" Jul 20 19:56:32.199524 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.199487 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 19:56:32.199524 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.199496 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 19:56:32.200025 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.199998 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:56:32.200084 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.200068 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:56:32.200084 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.200083 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:56:32.200598 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.200586 2559 policy_none.go:47] "Start" Jul 20 19:56:32.244131 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.244115 2559 manager.go:337] "Starting Device Plugin manager" Jul 20 19:56:32.244211 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.244145 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 19:56:32.244211 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.244154 2559 server.go:87] "Starting device plugin registration server" Jul 20 19:56:32.244413 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.244399 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 19:56:32.244474 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.244416 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 19:56:32.244519 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.244491 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 19:56:32.244595 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.244579 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 19:56:32.244595 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.244594 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 19:56:32.245029 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.244991 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 19:56:32.245106 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.245062 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.345467 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.345430 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:56:32.346700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.346684 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:56:32.346771 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.346715 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:56:32.346771 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.346725 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:56:32.346771 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.346753 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.353635 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.353596 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.353635 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.353615 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-157.ec2.internal\": node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.354442 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.354412 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 19:56:32.355770 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.355751 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 19:56:32.355865 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.355786 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 19:56:32.355865 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.355809 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 19:56:32.355865 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.355847 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 19:56:32.357612 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.357597 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:56:32.364650 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.364627 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.456171 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.456126 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal"] Jul 20 19:56:32.456334 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.456219 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:56:32.457284 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.457269 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:56:32.457362 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.457300 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:56:32.457362 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.457310 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:56:32.458320 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.458310 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:56:32.458457 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.458442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.458495 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.458478 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:56:32.459086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.459071 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:56:32.459169 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.459101 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:56:32.459169 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.459112 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:56:32.459169 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.459071 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:56:32.459251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.459174 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:56:32.459251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.459186 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:56:32.460142 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.460126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.460221 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.460156 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 19:56:32.460796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.460781 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientMemory" Jul 20 19:56:32.460857 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.460808 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 19:56:32.460857 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.460819 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeHasSufficientPID" Jul 20 19:56:32.464674 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.464660 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.475538 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.475522 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-157.ec2.internal\" not found" node="ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.479182 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.479167 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-157.ec2.internal\" not found" node="ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.481373 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.481357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2a59dab4358ddd0a796f2f418de304e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal\" (UID: \"e2a59dab4358ddd0a796f2f418de304e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.481447 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.481385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67ecf77339d42dd20887080fc19e8000-config\") pod \"kube-apiserver-proxy-ip-10-0-132-157.ec2.internal\" (UID: \"67ecf77339d42dd20887080fc19e8000\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.481447 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.481408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2a59dab4358ddd0a796f2f418de304e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal\" (UID: \"e2a59dab4358ddd0a796f2f418de304e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.565039 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.565006 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.581921 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.581900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67ecf77339d42dd20887080fc19e8000-config\") pod \"kube-apiserver-proxy-ip-10-0-132-157.ec2.internal\" (UID: \"67ecf77339d42dd20887080fc19e8000\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.582040 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.581928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2a59dab4358ddd0a796f2f418de304e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal\" (UID: \"e2a59dab4358ddd0a796f2f418de304e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.582040 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.581951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2a59dab4358ddd0a796f2f418de304e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal\" (UID: \"e2a59dab4358ddd0a796f2f418de304e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.582040 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.581993 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67ecf77339d42dd20887080fc19e8000-config\") pod \"kube-apiserver-proxy-ip-10-0-132-157.ec2.internal\" (UID: \"67ecf77339d42dd20887080fc19e8000\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.582163 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.581989 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2a59dab4358ddd0a796f2f418de304e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal\" (UID: \"e2a59dab4358ddd0a796f2f418de304e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.582163 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.582053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2a59dab4358ddd0a796f2f418de304e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal\" (UID: \"e2a59dab4358ddd0a796f2f418de304e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.665360 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.665315 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.765816 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.765781 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.777952 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.777930 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.782127 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:32.782103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" Jul 20 19:56:32.865973 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.865937 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:32.966476 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:32.966393 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:33.047643 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.047617 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:56:33.066635 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:33.066614 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:33.121072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.121049 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 19:56:33.121520 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.121170 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:56:33.121520 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.121213 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:56:33.121520 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.121213 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 19:56:33.167577 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:33.167555 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:33.186507 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.186465 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:51:32 +0000 UTC" deadline="2028-02-17 19:55:53.65713687 +0000 UTC" Jul 20 19:56:33.186507 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.186506 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13847h59m20.470635174s" Jul 20 19:56:33.267941 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:33.267911 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:33.295338 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:33.295299 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ecf77339d42dd20887080fc19e8000.slice/crio-5979c7bdf1a75213120094fca8a073df46fa6e211a5aad865365299b2d8679c2 WatchSource:0}: Error finding container 5979c7bdf1a75213120094fca8a073df46fa6e211a5aad865365299b2d8679c2: Status 404 returned error can't find the container with id 5979c7bdf1a75213120094fca8a073df46fa6e211a5aad865365299b2d8679c2 Jul 20 19:56:33.295603 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:33.295584 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a59dab4358ddd0a796f2f418de304e.slice/crio-3b5f9139f843fc01faf5ed0a9e243add823763c3b99ccfa5d98f490c3e691968 WatchSource:0}: Error finding container 3b5f9139f843fc01faf5ed0a9e243add823763c3b99ccfa5d98f490c3e691968: Status 404 returned error can't find the container with id 3b5f9139f843fc01faf5ed0a9e243add823763c3b99ccfa5d98f490c3e691968 Jul 20 19:56:33.300896 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.300881 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:56:33.359810 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.359763 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" event={"ID":"67ecf77339d42dd20887080fc19e8000","Type":"ContainerStarted","Data":"5979c7bdf1a75213120094fca8a073df46fa6e211a5aad865365299b2d8679c2"} Jul 20 19:56:33.360890 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.360871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" event={"ID":"e2a59dab4358ddd0a796f2f418de304e","Type":"ContainerStarted","Data":"3b5f9139f843fc01faf5ed0a9e243add823763c3b99ccfa5d98f490c3e691968"} Jul 20 19:56:33.368369 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:33.368343 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:33.470770 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:33.470740 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:33.571823 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:33.571743 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-157.ec2.internal\" not found" Jul 20 19:56:33.671234 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.671205 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:56:33.679608 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.679585 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" Jul 20 19:56:33.690708 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.690686 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:56:33.691730 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.691717 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" Jul 20 19:56:33.700852 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:33.700834 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 19:56:34.161275 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.161242 2559 apiserver.go:52] "Watching apiserver" Jul 20 19:56:34.171713 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.171677 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 19:56:34.172934 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.172908 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kcjkg","kube-system/global-pull-secret-syncer-kp69t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp","openshift-cluster-node-tuning-operator/tuned-m9vbn","openshift-dns/node-resolver-zhzlb","openshift-image-registry/node-ca-ccvzj","openshift-multus/multus-2lbnh","openshift-multus/multus-additional-cni-plugins-ldbtp","openshift-network-diagnostics/network-check-target-rfznb","kube-system/konnectivity-agent-m4ncs","kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal","openshift-multus/network-metrics-daemon-qf48l","openshift-network-operator/iptables-alerter-b267g"] Jul 20 19:56:34.175674 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.175645 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.178221 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.178200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:34.178323 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.178280 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:34.178862 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.178628 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 19:56:34.178862 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.178697 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v5j9q\"" Jul 20 19:56:34.178862 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.178631 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 19:56:34.179084 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.178901 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 19:56:34.181563 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.180309 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 19:56:34.181563 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.181210 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.183730 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.183535 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 19:56:34.183730 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.183553 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 19:56:34.183730 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.183649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qmtnp\"" Jul 20 19:56:34.183921 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.183885 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.184287 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.184268 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 19:56:34.184374 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.184357 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 19:56:34.184411 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.184392 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 19:56:34.184586 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.184564 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 19:56:34.186146 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.186121 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:56:34.186227 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.186161 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.186947 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.186808 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 19:56:34.187967 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.187942 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-298nb\"" Jul 20 19:56:34.188265 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.188200 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 19:56:34.188345 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.188263 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 19:56:34.188454 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.188439 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ppbws\"" Jul 20 19:56:34.188493 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.188475 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 19:56:34.188684 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.188672 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 19:56:34.189536 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.189170 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.189973 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.189949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-host\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.190125 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.189981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:34.190125 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-run-netns\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190125 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-etc-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190125 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovnkube-script-lib\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-systemd-units\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-systemd\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-log-socket\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190282 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjfkw\" (UniqueName: \"kubernetes.io/projected/9ed282b4-f600-477f-a292-8af7c85d4a7b-kube-api-access-kjfkw\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9hq\" (UniqueName: \"kubernetes.io/projected/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-kube-api-access-pm9hq\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-slash\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-ovn\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-node-log\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-cni-netd\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-serviceca\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-kubelet\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-var-lib-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-cni-bin\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovnkube-config\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.190776 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-env-overrides\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.191424 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.190806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovn-node-metrics-cert\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.191424 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.191093 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 19:56:34.191546 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.191459 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vt98k\"" Jul 20 19:56:34.191546 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.191498 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 19:56:34.191651 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.191545 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.195062 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.194385 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dvd6n\"" Jul 20 19:56:34.195062 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.194770 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 19:56:34.195062 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.194884 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 19:56:34.195532 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.195410 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 19:56:34.195532 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.195477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.196727 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.196709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.196808 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.196782 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:34.197229 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.197194 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 19:56:34.197417 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.197401 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 19:56:34.199245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.199225 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.199321 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.199262 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 19:56:34.199502 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.199487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5sqpb\"" Jul 20 19:56:34.202124 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.201774 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 19:56:34.202232 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.202145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4rzbm\"" Jul 20 19:56:34.202517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.202497 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 19:56:34.203180 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.203028 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:34.203581 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.203521 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:34.206752 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.206334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.208550 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.208528 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 19:56:34.208831 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.208813 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 19:56:34.209026 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.209011 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5lgnk\"" Jul 20 19:56:34.209127 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.209061 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 19:56:34.220162 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.220144 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pm5h6" Jul 20 19:56:34.229029 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.228724 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pm5h6" Jul 20 19:56:34.281026 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.280996 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 19:56:34.291980 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.291922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-serviceca\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.292161 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.291973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovnkube-config\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292161 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-env-overrides\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292161 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-host\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.292161 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovnkube-script-lib\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvqmb\" (UniqueName: \"kubernetes.io/projected/f1178e0d-9d99-47f4-862f-88298d70c1e1-kube-api-access-hvqmb\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.292371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.292371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292239 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-systemd-units\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-log-socket\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ff151a4-5119-4434-8578-6a1801e3db65-kubelet-config\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.292371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-device-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1178e0d-9d99-47f4-862f-88298d70c1e1-iptables-alerter-script\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-socket-dir-parent\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-daemon-config\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-node-log\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-serviceca\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-hostroot\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdvk\" (UniqueName: \"kubernetes.io/projected/e9996674-dea2-4863-95c9-9a2ec29548a4-kube-api-access-rfdvk\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292662 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovnkube-config\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.292707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-cnibin\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292741 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292812 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-node-log\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292836 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-log-socket\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292854 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-env-overrides\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292910 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-systemd-units\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-var-lib-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292970 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-host\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.293086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.292985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbhjf\" (UniqueName: \"kubernetes.io/projected/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-kube-api-access-jbhjf\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-var-lib-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d80347be-45ae-4f36-8930-395b487af755-agent-certs\") pod \"konnectivity-agent-m4ncs\" (UID: \"d80347be-45ae-4f36-8930-395b487af755\") " pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-k8s-cni-cncf-io\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58t44\" (UniqueName: \"kubernetes.io/projected/8d037ade-1fb7-42e6-b2f0-aab28b85567b-kube-api-access-58t44\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-system-cni-dir\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293401 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovnkube-script-lib\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:34.293476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-modprobe-d\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-tuned\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-sys-fs\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-cni-bin\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293623 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-kubernetes\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-systemd\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-sys\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9996674-dea2-4863-95c9-9a2ec29548a4-tmp-dir\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ff151a4-5119-4434-8578-6a1801e3db65-dbus\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293752 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-var-lib-kubelet\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz95s\" (UniqueName: \"kubernetes.io/projected/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-kube-api-access-tz95s\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-conf-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnwnc\" (UniqueName: \"kubernetes.io/projected/bc966792-b9a2-459f-a269-fa9289367373-kube-api-access-hnwnc\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-kubelet\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-cni-bin\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293941 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovn-node-metrics-cert\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.293981 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-host\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.293987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7c2d053-a1e9-47a7-b062-d1c32a06e074-tmp\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-socket-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d80347be-45ae-4f36-8930-395b487af755-konnectivity-ca\") pod \"konnectivity-agent-m4ncs\" (UID: \"d80347be-45ae-4f36-8930-395b487af755\") " pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-cni-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-etc-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysctl-conf\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d037ade-1fb7-42e6-b2f0-aab28b85567b-cni-binary-copy\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294202 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1178e0d-9d99-47f4-862f-88298d70c1e1-host-slash\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-system-cni-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-cni-multus\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9hq\" (UniqueName: \"kubernetes.io/projected/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-kube-api-access-pm9hq\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-ovn\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysctl-d\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/e7c2d053-a1e9-47a7-b062-d1c32a06e074-kube-api-access-5jqgw\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.294875 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-os-release\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9996674-dea2-4863-95c9-9a2ec29548a4-hosts-file\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-run-netns\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysconfig\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-run\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-kubelet\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-etc-kubernetes\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-cni-binary-copy\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-systemd\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjfkw\" (UniqueName: \"kubernetes.io/projected/9ed282b4-f600-477f-a292-8af7c85d4a7b-kube-api-access-kjfkw\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-lib-modules\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-netns\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-multus-certs\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-slash\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.295726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-cni-netd\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-registration-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-cnibin\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.294992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-os-release\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.295018 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.295275 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-kubelet\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.295320 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-cni-bin\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.295766 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296222 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-run-netns\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296308 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-systemd\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296364 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-slash\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296493 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-cni-netd\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296501 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.296645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-run-ovn\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.297361 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.296946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ed282b4-f600-477f-a292-8af7c85d4a7b-etc-openvswitch\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.300060 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.300019 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ed282b4-f600-477f-a292-8af7c85d4a7b-ovn-node-metrics-cert\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.301704 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.301687 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:56:34.301819 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.301709 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:56:34.301819 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.301722 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c45dw for pod openshift-network-diagnostics/network-check-target-rfznb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:34.301819 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.301787 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw podName:231fceb4-e27b-47e3-bd39-46d0cea89970 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:34.801766633 +0000 UTC m=+2.985614359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c45dw" (UniqueName: "kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw") pod "network-check-target-rfznb" (UID: "231fceb4-e27b-47e3-bd39-46d0cea89970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:34.304464 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.304438 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9hq\" (UniqueName: \"kubernetes.io/projected/4b62ac2e-19b2-4b50-973c-4dbc2b56c72f-kube-api-access-pm9hq\") pod \"node-ca-ccvzj\" (UID: \"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f\") " pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.304722 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.304699 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjfkw\" (UniqueName: \"kubernetes.io/projected/9ed282b4-f600-477f-a292-8af7c85d4a7b-kube-api-access-kjfkw\") pod \"ovnkube-node-kcjkg\" (UID: \"9ed282b4-f600-477f-a292-8af7c85d4a7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.395932 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.395894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ff151a4-5119-4434-8578-6a1801e3db65-kubelet-config\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.395939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-device-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.395967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1178e0d-9d99-47f4-862f-88298d70c1e1-iptables-alerter-script\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.395993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-socket-dir-parent\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-daemon-config\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396029 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ff151a4-5119-4434-8578-6a1801e3db65-kubelet-config\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-device-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-hostroot\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396079 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-socket-dir-parent\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdvk\" (UniqueName: \"kubernetes.io/projected/e9996674-dea2-4863-95c9-9a2ec29548a4-kube-api-access-rfdvk\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.396122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-cnibin\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbhjf\" (UniqueName: \"kubernetes.io/projected/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-kube-api-access-jbhjf\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396212 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d80347be-45ae-4f36-8930-395b487af755-agent-certs\") pod \"konnectivity-agent-m4ncs\" (UID: \"d80347be-45ae-4f36-8930-395b487af755\") " pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-k8s-cni-cncf-io\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58t44\" (UniqueName: \"kubernetes.io/projected/8d037ade-1fb7-42e6-b2f0-aab28b85567b-kube-api-access-58t44\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-system-cni-dir\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-modprobe-d\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-tuned\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-sys-fs\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-cni-bin\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-kubernetes\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-systemd\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-sys\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9996674-dea2-4863-95c9-9a2ec29548a4-tmp-dir\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ff151a4-5119-4434-8578-6a1801e3db65-dbus\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.396473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-var-lib-kubelet\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz95s\" (UniqueName: \"kubernetes.io/projected/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-kube-api-access-tz95s\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396496 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1178e0d-9d99-47f4-862f-88298d70c1e1-iptables-alerter-script\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-conf-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396523 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-conf-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnwnc\" (UniqueName: \"kubernetes.io/projected/bc966792-b9a2-459f-a269-fa9289367373-kube-api-access-hnwnc\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-cnibin\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-host\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7c2d053-a1e9-47a7-b062-d1c32a06e074-tmp\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-socket-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d80347be-45ae-4f36-8930-395b487af755-konnectivity-ca\") pod \"konnectivity-agent-m4ncs\" (UID: \"d80347be-45ae-4f36-8930-395b487af755\") " pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396670 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-cni-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysctl-conf\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396718 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d037ade-1fb7-42e6-b2f0-aab28b85567b-cni-binary-copy\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1178e0d-9d99-47f4-862f-88298d70c1e1-host-slash\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.396951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-system-cni-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396774 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-cni-multus\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396775 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-daemon-config\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysctl-d\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/e7c2d053-a1e9-47a7-b062-d1c32a06e074-kube-api-access-5jqgw\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396819 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-hostroot\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396850 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-cni-bin\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-os-release\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9996674-dea2-4863-95c9-9a2ec29548a4-hosts-file\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysconfig\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396910 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-run\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-kubelet\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-etc-kubernetes\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-cni-binary-copy\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.396988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-lib-modules\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-netns\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.397766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-multus-certs\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-registration-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397120 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-registration-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397150 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-systemd\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397156 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-k8s-cni-cncf-io\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.397161 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-system-cni-dir\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.397239 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret podName:7ff151a4-5119-4434-8578-6a1801e3db65 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:34.897219859 +0000 UTC m=+3.081067594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret") pod "global-pull-secret-syncer-kp69t" (UID: "7ff151a4-5119-4434-8578-6a1801e3db65") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.397270 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397288 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ff151a4-5119-4434-8578-6a1801e3db65-dbus\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397294 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-kubernetes\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.397319 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs podName:a1f5a31c-96c1-4057-a6cd-1e358ac4075c nodeName:}" failed. No retries permitted until 2026-07-20 19:56:34.897304784 +0000 UTC m=+3.081152503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs") pod "network-metrics-daemon-qf48l" (UID: "a1f5a31c-96c1-4057-a6cd-1e358ac4075c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397149 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysctl-conf\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-cnibin\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397365 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-host\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-os-release\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.398580 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397385 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-system-cni-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397381 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-modprobe-d\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9996674-dea2-4863-95c9-9a2ec29548a4-tmp-dir\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397470 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-etc-kubernetes\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397436 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-os-release\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-os-release\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397429 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-var-lib-kubelet\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397555 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-sys\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397577 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc966792-b9a2-459f-a269-fa9289367373-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397623 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-cnibin\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397626 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-sys-fs\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397666 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1178e0d-9d99-47f4-862f-88298d70c1e1-host-slash\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397669 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysctl-d\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397706 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-cni-multus\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397713 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-run\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397835 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqmb\" (UniqueName: \"kubernetes.io/projected/f1178e0d-9d99-47f4-862f-88298d70c1e1-kube-api-access-hvqmb\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.399350 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397878 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9996674-dea2-4863-95c9-9a2ec29548a4-hosts-file\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397894 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-sysconfig\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.397936 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d037ade-1fb7-42e6-b2f0-aab28b85567b-cni-binary-copy\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398052 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7c2d053-a1e9-47a7-b062-d1c32a06e074-lib-modules\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398062 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-socket-dir\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398137 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-multus-cni-dir\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398139 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d80347be-45ae-4f36-8930-395b487af755-konnectivity-ca\") pod \"konnectivity-agent-m4ncs\" (UID: \"d80347be-45ae-4f36-8930-395b487af755\") " pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398162 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-multus-certs\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-run-netns\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398253 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d037ade-1fb7-42e6-b2f0-aab28b85567b-host-var-lib-kubelet\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398455 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.398779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc966792-b9a2-459f-a269-fa9289367373-cni-binary-copy\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.399509 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d80347be-45ae-4f36-8930-395b487af755-agent-certs\") pod \"konnectivity-agent-m4ncs\" (UID: \"d80347be-45ae-4f36-8930-395b487af755\") " pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.400248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.400199 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7c2d053-a1e9-47a7-b062-d1c32a06e074-etc-tuned\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.400958 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.400589 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7c2d053-a1e9-47a7-b062-d1c32a06e074-tmp\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.405726 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.405695 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdvk\" (UniqueName: \"kubernetes.io/projected/e9996674-dea2-4863-95c9-9a2ec29548a4-kube-api-access-rfdvk\") pod \"node-resolver-zhzlb\" (UID: \"e9996674-dea2-4863-95c9-9a2ec29548a4\") " pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.405876 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.405859 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbhjf\" (UniqueName: \"kubernetes.io/projected/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-kube-api-access-jbhjf\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:34.408529 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.408500 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jqgw\" (UniqueName: \"kubernetes.io/projected/e7c2d053-a1e9-47a7-b062-d1c32a06e074-kube-api-access-5jqgw\") pod \"tuned-m9vbn\" (UID: \"e7c2d053-a1e9-47a7-b062-d1c32a06e074\") " pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.408629 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.408503 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvqmb\" (UniqueName: \"kubernetes.io/projected/f1178e0d-9d99-47f4-862f-88298d70c1e1-kube-api-access-hvqmb\") pod \"iptables-alerter-b267g\" (UID: \"f1178e0d-9d99-47f4-862f-88298d70c1e1\") " pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.408695 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.408661 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58t44\" (UniqueName: \"kubernetes.io/projected/8d037ade-1fb7-42e6-b2f0-aab28b85567b-kube-api-access-58t44\") pod \"multus-2lbnh\" (UID: \"8d037ade-1fb7-42e6-b2f0-aab28b85567b\") " pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.409440 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.409404 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnwnc\" (UniqueName: \"kubernetes.io/projected/bc966792-b9a2-459f-a269-fa9289367373-kube-api-access-hnwnc\") pod \"multus-additional-cni-plugins-ldbtp\" (UID: \"bc966792-b9a2-459f-a269-fa9289367373\") " pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.409547 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.409522 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz95s\" (UniqueName: \"kubernetes.io/projected/2d310e80-88ca-4bef-a3e9-dbc945ac05a1-kube-api-access-tz95s\") pod \"aws-ebs-csi-driver-node-8vmjp\" (UID: \"2d310e80-88ca-4bef-a3e9-dbc945ac05a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.495032 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.494940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ccvzj" Jul 20 19:56:34.504923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.504903 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:34.515509 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.515491 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:56:34.516691 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.516673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" Jul 20 19:56:34.521559 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.521540 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lbnh" Jul 20 19:56:34.529286 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.529268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhzlb" Jul 20 19:56:34.537097 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.537074 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" Jul 20 19:56:34.544970 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.544951 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" Jul 20 19:56:34.552815 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.552791 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:34.559622 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.559604 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b267g" Jul 20 19:56:34.577744 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.577719 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:56:34.902321 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.902230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:34.902321 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.902302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:34.902547 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:34.902343 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:34.902547 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902387 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:34.902547 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902451 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:56:34.902547 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902483 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:34.902547 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902497 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:56:34.902547 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902510 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c45dw for pod openshift-network-diagnostics/network-check-target-rfznb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:34.902547 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902455 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs podName:a1f5a31c-96c1-4057-a6cd-1e358ac4075c nodeName:}" failed. No retries permitted until 2026-07-20 19:56:35.902435808 +0000 UTC m=+4.086283530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs") pod "network-metrics-daemon-qf48l" (UID: "a1f5a31c-96c1-4057-a6cd-1e358ac4075c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:34.902863 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902564 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret podName:7ff151a4-5119-4434-8578-6a1801e3db65 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:35.902544825 +0000 UTC m=+4.086392551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret") pod "global-pull-secret-syncer-kp69t" (UID: "7ff151a4-5119-4434-8578-6a1801e3db65") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:34.902863 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:34.902581 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw podName:231fceb4-e27b-47e3-bd39-46d0cea89970 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:35.902570366 +0000 UTC m=+4.086418083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45dw" (UniqueName: "kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw") pod "network-check-target-rfznb" (UID: "231fceb4-e27b-47e3-bd39-46d0cea89970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:35.232047 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:35.231928 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:51:34 +0000 UTC" deadline="2028-03-05 15:03:06.980361584 +0000 UTC" Jul 20 19:56:35.232047 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:35.231980 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14251h6m31.748387227s" Jul 20 19:56:35.356297 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:35.356268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:35.356451 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.356429 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:35.369308 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:35.369280 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c2d053_a1e9_47a7_b062_d1c32a06e074.slice/crio-4faa3aa863d7dd7f70446d3d79509ab58480b89cfa310bef2bb77e0a3100ec29 WatchSource:0}: Error finding container 4faa3aa863d7dd7f70446d3d79509ab58480b89cfa310bef2bb77e0a3100ec29: Status 404 returned error can't find the container with id 4faa3aa863d7dd7f70446d3d79509ab58480b89cfa310bef2bb77e0a3100ec29 Jul 20 19:56:35.371169 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:35.371141 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80347be_45ae_4f36_8930_395b487af755.slice/crio-cceea3f77a0bcb5ac518aef67ee7aaed5dd83e46c6a2ce4089097034717bee6a WatchSource:0}: Error finding container cceea3f77a0bcb5ac518aef67ee7aaed5dd83e46c6a2ce4089097034717bee6a: Status 404 returned error can't find the container with id cceea3f77a0bcb5ac518aef67ee7aaed5dd83e46c6a2ce4089097034717bee6a Jul 20 19:56:35.372269 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:35.372243 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b62ac2e_19b2_4b50_973c_4dbc2b56c72f.slice/crio-2ec5d3d3668ad0e8d75383570ce6dffc15e29ac9ed3adcd48fb6be62d15a4b0a WatchSource:0}: Error finding container 2ec5d3d3668ad0e8d75383570ce6dffc15e29ac9ed3adcd48fb6be62d15a4b0a: Status 404 returned error can't find the container with id 2ec5d3d3668ad0e8d75383570ce6dffc15e29ac9ed3adcd48fb6be62d15a4b0a Jul 20 19:56:35.374258 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:56:35.374132 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d310e80_88ca_4bef_a3e9_dbc945ac05a1.slice/crio-06c9febe93882ac2b8efcdb7ba16bb57871f551b1c2b81baa411b18153f8de00 WatchSource:0}: Error finding container 06c9febe93882ac2b8efcdb7ba16bb57871f551b1c2b81baa411b18153f8de00: Status 404 returned error can't find the container with id 06c9febe93882ac2b8efcdb7ba16bb57871f551b1c2b81baa411b18153f8de00 Jul 20 19:56:35.911412 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:35.911083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:35.911412 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911356 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:35.911412 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:35.911387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911438 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs podName:a1f5a31c-96c1-4057-a6cd-1e358ac4075c nodeName:}" failed. No retries permitted until 2026-07-20 19:56:37.911415978 +0000 UTC m=+6.095263691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs") pod "network-metrics-daemon-qf48l" (UID: "a1f5a31c-96c1-4057-a6cd-1e358ac4075c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:35.911464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911499 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911554 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret podName:7ff151a4-5119-4434-8578-6a1801e3db65 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:37.911538363 +0000 UTC m=+6.095386079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret") pod "global-pull-secret-syncer-kp69t" (UID: "7ff151a4-5119-4434-8578-6a1801e3db65") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911589 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911607 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911621 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c45dw for pod openshift-network-diagnostics/network-check-target-rfznb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:35.911702 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:35.911662 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw podName:231fceb4-e27b-47e3-bd39-46d0cea89970 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:37.91164893 +0000 UTC m=+6.095496656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45dw" (UniqueName: "kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw") pod "network-check-target-rfznb" (UID: "231fceb4-e27b-47e3-bd39-46d0cea89970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:36.170243 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.169845 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 19:56:36.232724 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.232650 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:51:34 +0000 UTC" deadline="2028-03-23 16:23:58.259027465 +0000 UTC" Jul 20 19:56:36.232724 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.232705 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14684h27m22.026326955s" Jul 20 19:56:36.359642 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.359605 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:36.359821 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:36.359746 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:36.360345 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.360320 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:36.360461 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:36.360431 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:36.375063 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.375023 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" event={"ID":"e7c2d053-a1e9-47a7-b062-d1c32a06e074","Type":"ContainerStarted","Data":"4faa3aa863d7dd7f70446d3d79509ab58480b89cfa310bef2bb77e0a3100ec29"} Jul 20 19:56:36.391993 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.391953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerStarted","Data":"66ef663e8df47eef09e773282dda006672ae0ecb6645f3b010c604a3ad24c1ce"} Jul 20 19:56:36.398268 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.398229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b267g" event={"ID":"f1178e0d-9d99-47f4-862f-88298d70c1e1","Type":"ContainerStarted","Data":"97ccb3ab5b68276ee490223d7af78950bac20cc8dfe7f73ab335156bf94ed42a"} Jul 20 19:56:36.403410 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.403375 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lbnh" event={"ID":"8d037ade-1fb7-42e6-b2f0-aab28b85567b","Type":"ContainerStarted","Data":"f89199a233194d37bf28576b567f74c964a044b204ac80e38ebad0a94cf50fb6"} Jul 20 19:56:36.408623 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.408587 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" event={"ID":"67ecf77339d42dd20887080fc19e8000","Type":"ContainerStarted","Data":"9f7ed53389e78c639e4ff625c8adb98e737f3d46057c36cd7fa9adcd497f9246"} Jul 20 19:56:36.412549 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.412505 2559 generic.go:356] "Generic (PLEG): container finished" podID="e2a59dab4358ddd0a796f2f418de304e" containerID="1ba85988cb42fc578a607b316586f06ea0ebc2344f4b3243049f38abcd5ff551" exitCode=0 Jul 20 19:56:36.412657 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.412580 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" event={"ID":"e2a59dab4358ddd0a796f2f418de304e","Type":"ContainerDied","Data":"1ba85988cb42fc578a607b316586f06ea0ebc2344f4b3243049f38abcd5ff551"} Jul 20 19:56:36.427612 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.427512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"827fdbab6f55b001bcec242d211e426408279371f267a9bd9b4da166c5ac3404"} Jul 20 19:56:36.440863 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.440820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhzlb" event={"ID":"e9996674-dea2-4863-95c9-9a2ec29548a4","Type":"ContainerStarted","Data":"55bb9caaab5c0593fa879171e19518757b4afd54fadba9126e2f22134766b78f"} Jul 20 19:56:36.441976 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.441922 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-157.ec2.internal" podStartSLOduration=2.441900521 podStartE2EDuration="2.441900521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:36.426305948 +0000 UTC m=+4.610153681" watchObservedRunningTime="2026-07-20 19:56:36.441900521 +0000 UTC m=+4.625748258" Jul 20 19:56:36.450501 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.450462 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" event={"ID":"2d310e80-88ca-4bef-a3e9-dbc945ac05a1","Type":"ContainerStarted","Data":"06c9febe93882ac2b8efcdb7ba16bb57871f551b1c2b81baa411b18153f8de00"} Jul 20 19:56:36.465155 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.465049 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ccvzj" event={"ID":"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f","Type":"ContainerStarted","Data":"2ec5d3d3668ad0e8d75383570ce6dffc15e29ac9ed3adcd48fb6be62d15a4b0a"} Jul 20 19:56:36.471499 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:36.471455 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4ncs" event={"ID":"d80347be-45ae-4f36-8930-395b487af755","Type":"ContainerStarted","Data":"cceea3f77a0bcb5ac518aef67ee7aaed5dd83e46c6a2ce4089097034717bee6a"} Jul 20 19:56:37.356910 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:37.356871 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:37.357432 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.357031 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:37.504113 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:37.503957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" event={"ID":"e2a59dab4358ddd0a796f2f418de304e","Type":"ContainerStarted","Data":"acff8db25b9e9ddb6f8b0324f1121c301400be3e35225efbe38db365a3949870"} Jul 20 19:56:37.525693 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:37.525449 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-157.ec2.internal" podStartSLOduration=3.525425394 podStartE2EDuration="3.525425394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:37.524243559 +0000 UTC m=+5.708091361" watchObservedRunningTime="2026-07-20 19:56:37.525425394 +0000 UTC m=+5.709273132" Jul 20 19:56:37.933813 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:37.933770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:37.934021 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:37.933832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:37.934021 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:37.933872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:37.934169 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934043 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:56:37.934169 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934084 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:56:37.934169 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934099 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c45dw for pod openshift-network-diagnostics/network-check-target-rfznb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:37.934169 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934163 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw podName:231fceb4-e27b-47e3-bd39-46d0cea89970 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:41.93414248 +0000 UTC m=+10.117990205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45dw" (UniqueName: "kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw") pod "network-check-target-rfznb" (UID: "231fceb4-e27b-47e3-bd39-46d0cea89970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:37.934607 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934585 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:37.934688 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934648 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs podName:a1f5a31c-96c1-4057-a6cd-1e358ac4075c nodeName:}" failed. No retries permitted until 2026-07-20 19:56:41.934630346 +0000 UTC m=+10.118478065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs") pod "network-metrics-daemon-qf48l" (UID: "a1f5a31c-96c1-4057-a6cd-1e358ac4075c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:37.934753 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934709 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:37.934753 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:37.934742 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret podName:7ff151a4-5119-4434-8578-6a1801e3db65 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:41.934730419 +0000 UTC m=+10.118578148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret") pod "global-pull-secret-syncer-kp69t" (UID: "7ff151a4-5119-4434-8578-6a1801e3db65") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:38.356426 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:38.356343 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:38.356601 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:38.356476 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:38.357947 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:38.357920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:38.358375 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:38.358055 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:39.356808 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:39.356772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:39.356996 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:39.356920 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:40.357166 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:40.357134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:40.357635 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:40.357274 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:40.357794 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:40.357761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:40.357893 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:40.357868 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:41.356441 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:41.356246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:41.356441 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.356395 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:41.968196 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:41.968149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:41.968625 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:41.968211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:41.968625 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:41.968292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:41.968625 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.968424 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:41.968625 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.968486 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs podName:a1f5a31c-96c1-4057-a6cd-1e358ac4075c nodeName:}" failed. No retries permitted until 2026-07-20 19:56:49.968467599 +0000 UTC m=+18.152315309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs") pod "network-metrics-daemon-qf48l" (UID: "a1f5a31c-96c1-4057-a6cd-1e358ac4075c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:41.969138 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.968885 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:41.969138 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.968922 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret podName:7ff151a4-5119-4434-8578-6a1801e3db65 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:49.968912377 +0000 UTC m=+18.152760087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret") pod "global-pull-secret-syncer-kp69t" (UID: "7ff151a4-5119-4434-8578-6a1801e3db65") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:41.969138 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.969007 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:56:41.969138 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.969040 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:56:41.969138 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.969052 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c45dw for pod openshift-network-diagnostics/network-check-target-rfznb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:41.969138 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:41.969107 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw podName:231fceb4-e27b-47e3-bd39-46d0cea89970 nodeName:}" failed. No retries permitted until 2026-07-20 19:56:49.969095053 +0000 UTC m=+18.152942766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45dw" (UniqueName: "kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw") pod "network-check-target-rfznb" (UID: "231fceb4-e27b-47e3-bd39-46d0cea89970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:42.357354 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:42.357266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:42.357519 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:42.357376 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:42.357519 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:42.357437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:42.357630 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:42.357539 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:43.357157 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:43.356723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:43.357157 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:43.356840 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:44.356607 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:44.356254 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:44.356607 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:44.356380 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:44.356864 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:44.356743 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:44.356918 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:44.356870 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:45.356167 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:45.356126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:45.356556 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:45.356260 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:46.356160 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:46.356126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:46.356291 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:46.356241 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:46.356599 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:46.356296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:46.356599 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:46.356422 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:47.356678 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:47.356641 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:47.357154 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:47.356763 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:48.356254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:48.356215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:48.356434 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:48.356366 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:48.356434 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:48.356420 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:48.356560 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:48.356540 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:49.356042 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:49.355988 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:49.356447 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:49.356133 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:50.028791 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:50.028756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:50.028791 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:50.028792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:50.029007 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:50.028811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:50.029007 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.028950 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:56:50.029007 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.028950 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:50.029007 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.028963 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:56:50.029007 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.028981 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c45dw for pod openshift-network-diagnostics/network-check-target-rfznb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:50.029007 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.029007 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs podName:a1f5a31c-96c1-4057-a6cd-1e358ac4075c nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.028990359 +0000 UTC m=+34.212838070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs") pod "network-metrics-daemon-qf48l" (UID: "a1f5a31c-96c1-4057-a6cd-1e358ac4075c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:56:50.029223 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.029045 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw podName:231fceb4-e27b-47e3-bd39-46d0cea89970 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.029031338 +0000 UTC m=+34.212879050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45dw" (UniqueName: "kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw") pod "network-check-target-rfznb" (UID: "231fceb4-e27b-47e3-bd39-46d0cea89970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:56:50.029223 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.028950 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:50.029223 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.029108 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret podName:7ff151a4-5119-4434-8578-6a1801e3db65 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:06.029096175 +0000 UTC m=+34.212943885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret") pod "global-pull-secret-syncer-kp69t" (UID: "7ff151a4-5119-4434-8578-6a1801e3db65") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:56:50.356789 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:50.356705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:50.356789 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:50.356728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:50.357299 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.356852 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:50.357299 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:50.356987 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:51.356769 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:51.356736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:51.356924 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:51.356858 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:52.357225 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:52.357195 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:52.357649 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:52.357302 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:52.357649 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:52.357595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:52.357757 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:52.357664 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:53.356729 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:53.356682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:53.356912 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:53.356821 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:54.363102 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.359008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:54.363102 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:54.359330 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:54.363102 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.359693 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:54.363102 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:54.359776 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:54.540872 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.540839 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lbnh" event={"ID":"8d037ade-1fb7-42e6-b2f0-aab28b85567b","Type":"ContainerStarted","Data":"7cd870ae34baa3de24ed48172469f86388e2095675cfc15159d581dc43f91c38"} Jul 20 19:56:54.542890 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.542863 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"4738ac017d3b8068c988440fe6ef858eb7670fa8fca3440b275605685ec82e3f"} Jul 20 19:56:54.543033 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.542942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"3a494ba1983cca8ad8f40a5a96ec032d700878606c01158831b5833ab040e055"} Jul 20 19:56:54.546641 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.545934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhzlb" event={"ID":"e9996674-dea2-4863-95c9-9a2ec29548a4","Type":"ContainerStarted","Data":"0c920c43b0759c2c213ebe819889d83cd197331bf69920fab7bf0d7586a43288"} Jul 20 19:56:54.547765 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.547741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" event={"ID":"2d310e80-88ca-4bef-a3e9-dbc945ac05a1","Type":"ContainerStarted","Data":"0dbc59d946aa259c1f4c2ec61ea9a6574ccb91bcc0cf893be5d3bc5246f65484"} Jul 20 19:56:54.549356 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.549335 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ccvzj" event={"ID":"4b62ac2e-19b2-4b50-973c-4dbc2b56c72f","Type":"ContainerStarted","Data":"3453f8d04cf47ab531a58a627ce829bee1dc6e1da196b66c4c74673da75157a6"} Jul 20 19:56:54.551962 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.551898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4ncs" event={"ID":"d80347be-45ae-4f36-8930-395b487af755","Type":"ContainerStarted","Data":"d843757fe300a59ecfb78f59b2fbff444477ba03472509439ffa3d943bcbcce3"} Jul 20 19:56:54.553526 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.553232 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" event={"ID":"e7c2d053-a1e9-47a7-b062-d1c32a06e074","Type":"ContainerStarted","Data":"099701aa8e7168544e27d0553e511c8517bcbc8c6537b99f6291e30cde46d3c0"} Jul 20 19:56:54.554417 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.554322 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc966792-b9a2-459f-a269-fa9289367373" containerID="39c0f056c9f7c5e99f348ba1c81285c5a2f1e4853b5c09cd8f6d28311a64a8ba" exitCode=0 Jul 20 19:56:54.554417 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.554356 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerDied","Data":"39c0f056c9f7c5e99f348ba1c81285c5a2f1e4853b5c09cd8f6d28311a64a8ba"} Jul 20 19:56:54.560403 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.559892 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2lbnh" podStartSLOduration=2.619927386 podStartE2EDuration="21.559876594s" totalImagesPullingTime="18.939949208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:54.559504003 +0000 UTC m=+22.743351735" watchObservedRunningTime="2026-07-20 19:56:54.559876594 +0000 UTC m=+22.743724325" Jul 20 19:56:54.611939 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.611897 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m4ncs" podStartSLOduration=7.053798403 podStartE2EDuration="21.611880845s" totalImagesPullingTime="14.558082442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:54.596832953 +0000 UTC m=+22.780680697" watchObservedRunningTime="2026-07-20 19:56:54.611880845 +0000 UTC m=+22.795728576" Jul 20 19:56:54.629968 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.629923 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m9vbn" podStartSLOduration=3.724174641 podStartE2EDuration="22.629904084s" totalImagesPullingTime="18.905729443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:54.629799236 +0000 UTC m=+22.813646968" watchObservedRunningTime="2026-07-20 19:56:54.629904084 +0000 UTC m=+22.813751817" Jul 20 19:56:54.630149 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.630121 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ccvzj" podStartSLOduration=8.072794723 podStartE2EDuration="22.630113464s" totalImagesPullingTime="14.557318741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:54.611671581 +0000 UTC m=+22.795519314" watchObservedRunningTime="2026-07-20 19:56:54.630113464 +0000 UTC m=+22.813961196" Jul 20 19:56:54.653832 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.653783 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhzlb" podStartSLOduration=2.779641971 podStartE2EDuration="21.653770577s" totalImagesPullingTime="18.874128606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:54.653262814 +0000 UTC m=+22.837110545" watchObservedRunningTime="2026-07-20 19:56:54.653770577 +0000 UTC m=+22.837618308" Jul 20 19:56:54.654626 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.654596 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:54.655315 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.655297 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:54.703650 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.703625 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:54.791820 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.791733 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:54.892651 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:54.892624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:55.101351 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.101321 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:55.172803 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.172772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:55.356077 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.355982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:55.356240 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:55.356138 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:55.559883 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.559848 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"a058eb51a77a9d239964fe707b489c1ea6094001b80ed22ce17e155c43330344"} Jul 20 19:56:55.560796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.559939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"0d1db34c697793e932781fcfdaed74d4958c9a27f216d93d1efaae8a66d982a8"} Jul 20 19:56:55.560796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.559992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"0081d965a6c49995a4b021945dfeabbc5a6d0c9e2eca9119e123cbf7e0b3ce6c"} Jul 20 19:56:55.560796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.560058 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"3914bc3bf5142ee34acdf47f052877b20c5993631d0ff4dada37a88237dfe1ee"} Jul 20 19:56:55.560796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.560494 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:55.560998 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.560855 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m4ncs" Jul 20 19:56:55.659226 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:55.659153 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:56.202509 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.202402 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 19:56:56.262466 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.262347 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:56:56.202419742Z","UUID":"8c857f53-2f8d-4720-ad01-ea105700f511","Handler":null,"Name":"","Endpoint":""} Jul 20 19:56:56.263878 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.263861 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 19:56:56.263967 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.263897 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 19:56:56.356264 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.356192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:56.356264 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.356240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:56.356467 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:56.356316 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:56.356467 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:56.356382 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:56.563129 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.563096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b267g" event={"ID":"f1178e0d-9d99-47f4-862f-88298d70c1e1","Type":"ContainerStarted","Data":"3d260b8df81625f37393036ffd713494a42641daf2cbe7e08e2a57ccb12240a4"} Jul 20 19:56:56.564871 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.564849 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" event={"ID":"2d310e80-88ca-4bef-a3e9-dbc945ac05a1","Type":"ContainerStarted","Data":"aae359570534036dc886187eeae5f3559d6fce169100a5fb3ea70e597f6fed99"} Jul 20 19:56:56.583164 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.583122 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b267g" podStartSLOduration=4.716020545 podStartE2EDuration="23.583110158s" totalImagesPullingTime="18.867089613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:56.582775985 +0000 UTC m=+24.766623715" watchObservedRunningTime="2026-07-20 19:56:56.583110158 +0000 UTC m=+24.766957889" Jul 20 19:56:56.727562 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.727496 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:56.796675 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:56.796630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:57.356585 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:57.356565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:57.356709 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:57.356664 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:57.570734 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:57.570674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"854da49495185162b281e19241a8108c6c3abae6d8c95a0dcf2a63f48e74dd7e"} Jul 20 19:56:58.356783 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:58.356597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:56:58.356990 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:58.356603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:56:58.356990 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:58.356856 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:56:58.356990 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:58.356980 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:56:59.305594 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.305568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:59.356141 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.356126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:56:59.356245 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:56:59.356218 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:56:59.360552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.360530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:56:59.576766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.576570 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc966792-b9a2-459f-a269-fa9289367373" containerID="b7017ede94d236852af61933cd8dbbc4801cd47331dd099c83a7e263fca1f6cf" exitCode=0 Jul 20 19:56:59.576882 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.576645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerDied","Data":"b7017ede94d236852af61933cd8dbbc4801cd47331dd099c83a7e263fca1f6cf"} Jul 20 19:56:59.580653 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.580625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" event={"ID":"9ed282b4-f600-477f-a292-8af7c85d4a7b","Type":"ContainerStarted","Data":"43a761974c8d913bc1b7f382205ec312135d87b55408a20dcc1c969e25e97b97"} Jul 20 19:56:59.580843 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.580827 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:59.580931 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.580894 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:59.582955 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.582935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" event={"ID":"2d310e80-88ca-4bef-a3e9-dbc945ac05a1","Type":"ContainerStarted","Data":"29ff5ab91771f93b08ceb2753b31c2c45609b46316e11aac78dcc7b19b746f5d"} Jul 20 19:56:59.596502 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.596484 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:56:59.641605 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.641569 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" podStartSLOduration=8.701177219 podStartE2EDuration="27.641557351s" totalImagesPullingTime="18.940380132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:59.640895732 +0000 UTC m=+27.824743485" watchObservedRunningTime="2026-07-20 19:56:59.641557351 +0000 UTC m=+27.825405083" Jul 20 19:56:59.641732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:56:59.641714 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vmjp" podStartSLOduration=3.287837863 podStartE2EDuration="26.641709957s" totalImagesPullingTime="23.353872094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:56:59.616498461 +0000 UTC m=+27.800346192" watchObservedRunningTime="2026-07-20 19:56:59.641709957 +0000 UTC m=+27.825557688" Jul 20 19:57:00.356628 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:00.356599 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:00.357261 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:00.356720 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:00.357261 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:00.356768 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:00.357261 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:00.356865 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:00.586066 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:00.585965 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:57:00.605205 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:00.605182 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:57:01.356160 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.356134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:01.356309 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:01.356234 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:01.480479 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.480412 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rfznb"] Jul 20 19:57:01.480847 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.480493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:01.480847 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:01.480566 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:01.487230 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.487207 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kp69t"] Jul 20 19:57:01.487355 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.487292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:01.487412 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:01.487377 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:01.487772 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.487749 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qf48l"] Jul 20 19:57:01.589628 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.589603 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc966792-b9a2-459f-a269-fa9289367373" containerID="7c7f5264e63d6073d9dff9cbec3a61b1efe8084cb4f1d3e79cdc6d7cc9cabfee" exitCode=0 Jul 20 19:57:01.589741 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.589680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerDied","Data":"7c7f5264e63d6073d9dff9cbec3a61b1efe8084cb4f1d3e79cdc6d7cc9cabfee"} Jul 20 19:57:01.589848 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:01.589831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:01.589955 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:01.589937 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:02.082521 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:02.082485 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:02.177268 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:02.177076 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:02.350035 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:02.349952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:02.450048 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:02.450005 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:02.559248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:02.559223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:02.783975 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:02.783956 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:02.887024 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:02.886990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.150156 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.150105 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.241352 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.241329 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.309912 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.309888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.356935 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.356909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:03.357043 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.356940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:03.357085 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:03.357040 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:03.357119 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.357079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:03.357186 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:03.357170 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:03.357239 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:03.357226 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:03.410675 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.410606 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.596069 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.596041 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc966792-b9a2-459f-a269-fa9289367373" containerID="2a53b14b2d1d86272d4356c0c41b76ee7f09d3b06f6564edf92fccdb43d0a513" exitCode=0 Jul 20 19:57:03.596508 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.596080 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerDied","Data":"2a53b14b2d1d86272d4356c0c41b76ee7f09d3b06f6564edf92fccdb43d0a513"} Jul 20 19:57:03.703102 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.703041 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.817549 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.817520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.925096 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.925063 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:03.994594 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:03.994539 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhzlb_e9996674-dea2-4863-95c9-9a2ec29548a4/dns-node-resolver/0.log" Jul 20 19:57:04.022859 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:04.022838 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:04.168003 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:04.167977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:04.228569 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:04.228532 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:04.434593 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:04.434517 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:04.594334 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:04.594312 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ccvzj_4b62ac2e-19b2-4b50-973c-4dbc2b56c72f/node-ca/0.log" Jul 20 19:57:05.329304 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:05.329273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:05.356254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:05.356229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:05.356393 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:05.356229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:05.356393 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:05.356341 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:05.356499 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:05.356458 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:05.356499 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:05.356229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:05.356591 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:05.356563 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:06.054119 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:06.054041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:06.054119 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:06.054087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:06.054323 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054137 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 19:57:06.054323 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:06.054149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:06.054323 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054203 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret podName:7ff151a4-5119-4434-8578-6a1801e3db65 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:38.054182573 +0000 UTC m=+66.238030290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret") pod "global-pull-secret-syncer-kp69t" (UID: "7ff151a4-5119-4434-8578-6a1801e3db65") : object "kube-system"/"original-pull-secret" not registered Jul 20 19:57:06.054323 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054231 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:57:06.054323 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054264 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 19:57:06.054323 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054285 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 19:57:06.054323 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054298 2559 projected.go:196] Error preparing data for projected volume kube-api-access-c45dw for pod openshift-network-diagnostics/network-check-target-rfznb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:57:06.054610 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054272 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs podName:a1f5a31c-96c1-4057-a6cd-1e358ac4075c nodeName:}" failed. No retries permitted until 2026-07-20 19:57:38.054261499 +0000 UTC m=+66.238109225 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs") pod "network-metrics-daemon-qf48l" (UID: "a1f5a31c-96c1-4057-a6cd-1e358ac4075c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 19:57:06.054610 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:06.054363 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw podName:231fceb4-e27b-47e3-bd39-46d0cea89970 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:38.054347815 +0000 UTC m=+66.238195525 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c45dw" (UniqueName: "kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw") pod "network-check-target-rfznb" (UID: "231fceb4-e27b-47e3-bd39-46d0cea89970") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 19:57:06.589772 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:06.589738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:07.356225 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:07.356187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:07.356411 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:07.356326 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:07.356411 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:07.356203 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:07.356520 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:07.356410 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:07.356520 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:07.356196 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:07.356520 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:07.356486 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:08.506889 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:08.506815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:08.610932 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:08.610902 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc966792-b9a2-459f-a269-fa9289367373" containerID="9a7525a81e978bb894228d644373818a55ba98b9465fdcdf7566dffe354a7dd4" exitCode=0 Jul 20 19:57:08.611093 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:08.610943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerDied","Data":"9a7525a81e978bb894228d644373818a55ba98b9465fdcdf7566dffe354a7dd4"} Jul 20 19:57:08.901446 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:08.901360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.002479 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.002446 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.261879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.261796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.356499 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.356465 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:09.356697 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.356570 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:09.356697 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:09.356671 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:09.356697 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:09.356571 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:09.356856 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.356573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:09.356856 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:09.356765 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:09.368878 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.368848 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.497251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.497221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.598738 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.598667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.615955 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.615925 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc966792-b9a2-459f-a269-fa9289367373" containerID="c0e630568851ce94c8d09832798aba71552ea2d95c31098f3546e888932a6547" exitCode=0 Jul 20 19:57:09.616122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.615980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerDied","Data":"c0e630568851ce94c8d09832798aba71552ea2d95c31098f3546e888932a6547"} Jul 20 19:57:09.792746 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.792561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:09.995238 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:09.995201 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:10.621253 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:10.621222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" event={"ID":"bc966792-b9a2-459f-a269-fa9289367373","Type":"ContainerStarted","Data":"e8d315d53c08e6b59b92ec7a7e857d5d7b6414e3cbbf9baeda874a328c721551"} Jul 20 19:57:10.642895 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:10.642848 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ldbtp" podStartSLOduration=7.340590239 podStartE2EDuration="37.64283032s" totalImagesPullingTime="30.302240081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:10.640936959 +0000 UTC m=+38.824784691" watchObservedRunningTime="2026-07-20 19:57:10.64283032 +0000 UTC m=+38.826678065" Jul 20 19:57:10.791695 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:10.791665 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:11.193131 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:11.193105 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:11.357115 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:11.357037 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:11.357249 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:11.357048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:11.357249 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:11.357172 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:11.357249 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:11.357048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:11.357355 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:11.357267 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:11.357355 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:11.357339 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:11.375353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:11.375326 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:11.432718 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:11.432692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:11.995278 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:11.995252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.316644 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:12.316584 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.418093 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:12.418062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.593827 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:12.593763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.657931 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:12.657908 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:12.995150 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:12.995130 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:13.053463 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:13.053439 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:13.356500 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:13.356449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:13.356578 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:13.356539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:13.356578 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:13.356548 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:13.356667 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:13.356609 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:13.356667 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:13.356631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:13.356771 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:13.356750 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:13.794648 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:13.794625 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:14.195373 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:14.195352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:14.409008 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:14.408983 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:14.520758 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:14.520713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:14.621175 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:14.621152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:14.673322 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:14.673306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:14.738412 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:14.738390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:14.839492 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:14.839445 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:15.356170 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:15.356149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:15.356465 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:15.356156 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:15.356465 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:15.356227 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:15.356465 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:15.356156 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:15.356465 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:15.356292 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:15.356465 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:15.356364 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:15.799387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:15.799360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:16.198121 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:16.198098 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:16.384250 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:16.384221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:16.486439 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:16.486383 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:16.600084 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:16.600065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:16.847396 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:16.847342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:17.356385 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:17.356361 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:17.356560 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:17.356465 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:17.356560 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:17.356477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:17.356560 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:17.356472 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:17.356560 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:17.356532 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:17.356726 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:17.356630 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:17.597707 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:17.597685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:17.988569 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:17.988549 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:18.209378 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:18.209350 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:18.599002 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:18.598973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:18.881763 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:18.881739 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:18.982190 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:18.982170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:19.192611 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:19.192562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:19.356131 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:19.356112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:19.356131 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:19.356124 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:19.356249 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:19.356112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:19.356249 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:19.356197 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:19.356309 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:19.356257 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:19.356357 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:19.356342 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:19.395316 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:19.395289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:19.593062 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:19.592999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:21.356684 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:21.356652 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:21.356684 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:21.356664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:21.357094 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:21.356747 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:21.357094 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:21.356794 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:21.357094 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:21.356882 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:21.357094 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:21.356927 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:23.356961 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:23.356932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:23.357434 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:23.356932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:23.357434 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:23.357063 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:23.357434 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:23.356932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:23.357434 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:23.357090 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:23.357434 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:23.357161 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:24.836239 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:24.836207 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:24.938802 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:24.938773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.036743 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.036720 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.137418 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.137395 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.279605 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.279583 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.336879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.336853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.356804 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.356788 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:25.356895 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.356832 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:25.356933 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:25.356897 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp69t" podUID="7ff151a4-5119-4434-8578-6a1801e3db65" Jul 20 19:57:25.356933 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.356907 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:25.356991 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:25.356979 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qf48l" podUID="a1f5a31c-96c1-4057-a6cd-1e358ac4075c" Jul 20 19:57:25.357073 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:25.357058 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfznb" podUID="231fceb4-e27b-47e3-bd39-46d0cea89970" Jul 20 19:57:25.587294 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.587216 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.701126 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.701095 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.853211 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.853155 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:25.957512 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:25.957490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:26.092952 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.092934 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-157.ec2.internal" event="NodeReady" Jul 20 19:57:26.093084 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.093073 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 19:57:26.103850 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.103800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:26.169971 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.169950 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-64wmx"] Jul 20 19:57:26.189432 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.189414 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4nnr2"] Jul 20 19:57:26.189589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.189552 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.191744 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.191720 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 19:57:26.192124 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.192109 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 19:57:26.192209 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.192122 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fzgwk\"" Jul 20 19:57:26.215618 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.215603 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nnr2"] Jul 20 19:57:26.215701 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.215633 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64wmx"] Jul 20 19:57:26.215735 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.215705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.218110 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.218095 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 19:57:26.218198 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.218140 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 19:57:26.218198 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.218100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 19:57:26.218282 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.218250 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 19:57:26.218316 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.218304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-84blb\"" Jul 20 19:57:26.251337 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.251314 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-df59t"] Jul 20 19:57:26.273506 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.273487 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-df59t"] Jul 20 19:57:26.273643 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.273614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.276158 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.276139 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qsckw\"" Jul 20 19:57:26.276158 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.276158 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 19:57:26.276346 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.276329 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 19:57:26.276504 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.276484 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 19:57:26.300566 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.300541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2019a249-ea10-4064-bd63-8186391c8632-config-volume\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.300643 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.300602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2019a249-ea10-4064-bd63-8186391c8632-metrics-tls\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.300643 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.300619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2019a249-ea10-4064-bd63-8186391c8632-tmp-dir\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.300704 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.300662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm9tv\" (UniqueName: \"kubernetes.io/projected/2019a249-ea10-4064-bd63-8186391c8632-kube-api-access-pm9tv\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.310623 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.310604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:26.381190 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.381167 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:26.401151 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2019a249-ea10-4064-bd63-8186391c8632-config-volume\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.401232 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpdz5\" (UniqueName: \"kubernetes.io/projected/e80fb783-f266-4599-beb7-fd4708fe0fae-kube-api-access-dpdz5\") pod \"ingress-canary-df59t\" (UID: \"e80fb783-f266-4599-beb7-fd4708fe0fae\") " pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.401232 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-crio-socket\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.401318 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e80fb783-f266-4599-beb7-fd4708fe0fae-cert\") pod \"ingress-canary-df59t\" (UID: \"e80fb783-f266-4599-beb7-fd4708fe0fae\") " pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.401318 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2019a249-ea10-4064-bd63-8186391c8632-metrics-tls\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.401393 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2019a249-ea10-4064-bd63-8186391c8632-tmp-dir\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.401393 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-data-volume\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.401393 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.401393 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lhhg\" (UniqueName: \"kubernetes.io/projected/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-kube-api-access-5lhhg\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.401577 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.401577 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm9tv\" (UniqueName: \"kubernetes.io/projected/2019a249-ea10-4064-bd63-8186391c8632-kube-api-access-pm9tv\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.401669 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401623 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2019a249-ea10-4064-bd63-8186391c8632-config-volume\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.401669 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.401631 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2019a249-ea10-4064-bd63-8186391c8632-tmp-dir\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.405268 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.405251 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2019a249-ea10-4064-bd63-8186391c8632-metrics-tls\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.410886 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.410862 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm9tv\" (UniqueName: \"kubernetes.io/projected/2019a249-ea10-4064-bd63-8186391c8632-kube-api-access-pm9tv\") pod \"dns-default-64wmx\" (UID: \"2019a249-ea10-4064-bd63-8186391c8632\") " pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.490590 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.490569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:26.498566 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.498547 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:26.501766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.501750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-data-volume\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.501817 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.501774 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.501817 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.501791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lhhg\" (UniqueName: \"kubernetes.io/projected/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-kube-api-access-5lhhg\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.501817 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.501807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.501911 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.501850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpdz5\" (UniqueName: \"kubernetes.io/projected/e80fb783-f266-4599-beb7-fd4708fe0fae-kube-api-access-dpdz5\") pod \"ingress-canary-df59t\" (UID: \"e80fb783-f266-4599-beb7-fd4708fe0fae\") " pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.501959 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.501910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-crio-socket\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.502081 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.502056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e80fb783-f266-4599-beb7-fd4708fe0fae-cert\") pod \"ingress-canary-df59t\" (UID: \"e80fb783-f266-4599-beb7-fd4708fe0fae\") " pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.502152 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.502097 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-crio-socket\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.502152 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.502111 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-data-volume\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.502379 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.502357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.504061 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.504043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.504299 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.504282 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e80fb783-f266-4599-beb7-fd4708fe0fae-cert\") pod \"ingress-canary-df59t\" (UID: \"e80fb783-f266-4599-beb7-fd4708fe0fae\") " pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.519245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.519218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lhhg\" (UniqueName: \"kubernetes.io/projected/bf65d6bd-1f97-4528-9f3d-1cc7119be8b4-kube-api-access-5lhhg\") pod \"insights-runtime-extractor-4nnr2\" (UID: \"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4\") " pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.520324 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.520305 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpdz5\" (UniqueName: \"kubernetes.io/projected/e80fb783-f266-4599-beb7-fd4708fe0fae-kube-api-access-dpdz5\") pod \"ingress-canary-df59t\" (UID: \"e80fb783-f266-4599-beb7-fd4708fe0fae\") " pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.523098 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.523081 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nnr2" Jul 20 19:57:26.582626 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.582594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-df59t" Jul 20 19:57:26.633384 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.633118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:26.699634 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.699607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-64wmx"] Jul 20 19:57:26.702421 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.702401 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nnr2"] Jul 20 19:57:26.703910 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:26.703891 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2019a249_ea10_4064_bd63_8186391c8632.slice/crio-36dea15230d78ba2c94732e44a3f78dd64aa0fe87cd0ac714f2274f0b09c9105 WatchSource:0}: Error finding container 36dea15230d78ba2c94732e44a3f78dd64aa0fe87cd0ac714f2274f0b09c9105: Status 404 returned error can't find the container with id 36dea15230d78ba2c94732e44a3f78dd64aa0fe87cd0ac714f2274f0b09c9105 Jul 20 19:57:26.706214 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:26.706192 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf65d6bd_1f97_4528_9f3d_1cc7119be8b4.slice/crio-c9250cb52c7215a5572b2b72995c65cdbcffabc1c09b0b1777b17e3b252234f7 WatchSource:0}: Error finding container c9250cb52c7215a5572b2b72995c65cdbcffabc1c09b0b1777b17e3b252234f7: Status 404 returned error can't find the container with id c9250cb52c7215a5572b2b72995c65cdbcffabc1c09b0b1777b17e3b252234f7 Jul 20 19:57:26.740905 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:26.740877 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-df59t"] Jul 20 19:57:26.743828 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:26.743806 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80fb783_f266_4599_beb7_fd4708fe0fae.slice/crio-d1ad07c778adf7f186f78080ac277d46760747ad10be9c5e7b6dbce6c8e54649 WatchSource:0}: Error finding container d1ad07c778adf7f186f78080ac277d46760747ad10be9c5e7b6dbce6c8e54649: Status 404 returned error can't find the container with id d1ad07c778adf7f186f78080ac277d46760747ad10be9c5e7b6dbce6c8e54649 Jul 20 19:57:27.356979 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.356949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:27.357458 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.356987 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:27.357458 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.356949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:27.361977 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.360483 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:57:27.361977 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.360709 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:57:27.361977 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.360907 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mmqwm\"" Jul 20 19:57:27.361977 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.361124 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qx848\"" Jul 20 19:57:27.361977 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.361354 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:57:27.361977 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.361553 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:57:27.661471 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.661435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-df59t" event={"ID":"e80fb783-f266-4599-beb7-fd4708fe0fae","Type":"ContainerStarted","Data":"d1ad07c778adf7f186f78080ac277d46760747ad10be9c5e7b6dbce6c8e54649"} Jul 20 19:57:27.663628 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.663579 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nnr2" event={"ID":"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4","Type":"ContainerStarted","Data":"c9250cb52c7215a5572b2b72995c65cdbcffabc1c09b0b1777b17e3b252234f7"} Jul 20 19:57:27.667476 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.667450 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64wmx" event={"ID":"2019a249-ea10-4064-bd63-8186391c8632","Type":"ContainerStarted","Data":"36dea15230d78ba2c94732e44a3f78dd64aa0fe87cd0ac714f2274f0b09c9105"} Jul 20 19:57:27.913353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:27.913279 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:32.079851 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.079788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:32.246656 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.246626 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj"] Jul 20 19:57:32.249406 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.249375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" Jul 20 19:57:32.251536 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.251516 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wj74l\"" Jul 20 19:57:32.251691 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.251673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 19:57:32.253160 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.253130 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:32.258451 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.258430 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj"] Jul 20 19:57:32.337118 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.337044 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:32.339974 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.339942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e3287f3b-95d3-4e97-ae29-b23bd27baed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jqcgj\" (UID: \"e3287f3b-95d3-4e97-ae29-b23bd27baed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" Jul 20 19:57:32.439892 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.439872 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:32.440780 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.440753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e3287f3b-95d3-4e97-ae29-b23bd27baed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jqcgj\" (UID: \"e3287f3b-95d3-4e97-ae29-b23bd27baed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" Jul 20 19:57:32.443070 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.443050 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e3287f3b-95d3-4e97-ae29-b23bd27baed4-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jqcgj\" (UID: \"e3287f3b-95d3-4e97-ae29-b23bd27baed4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" Jul 20 19:57:32.543092 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.543067 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:32.563214 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.563172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" Jul 20 19:57:32.603751 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.603674 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcjkg" Jul 20 19:57:32.651003 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.650815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:32.681725 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.681680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-df59t" event={"ID":"e80fb783-f266-4599-beb7-fd4708fe0fae","Type":"ContainerStarted","Data":"488bba9a794d8b7caf11eaee3208a47590dc203b48aceaae91f9fcea04f8ab45"} Jul 20 19:57:32.683198 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.683166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nnr2" event={"ID":"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4","Type":"ContainerStarted","Data":"e67d97b9618cbc9057a7686ab58dc1f61f9c261e0687c36ff932487f46d15984"} Jul 20 19:57:32.684712 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.684663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64wmx" event={"ID":"2019a249-ea10-4064-bd63-8186391c8632","Type":"ContainerStarted","Data":"cedb1219f86895ec348e91122392c9a659c073c119efc657495b7517fdfa5542"} Jul 20 19:57:32.684712 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.684699 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-64wmx" event={"ID":"2019a249-ea10-4064-bd63-8186391c8632","Type":"ContainerStarted","Data":"167f0e1f8f81c3ce87064f1e7f4fe6776dbe95c80ffb6ddeb3d67c6a6fb84fbd"} Jul 20 19:57:32.684929 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.684811 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:32.695603 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.695586 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj"] Jul 20 19:57:32.699002 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.698947 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-df59t" podStartSLOduration=1.05921058 podStartE2EDuration="6.69893383s" totalImagesPullingTime="5.63972325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.698416966 +0000 UTC m=+60.882264701" watchObservedRunningTime="2026-07-20 19:57:32.69893383 +0000 UTC m=+60.882781539" Jul 20 19:57:32.699559 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:32.699543 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3287f3b_95d3_4e97_ae29_b23bd27baed4.slice/crio-5bc02dcfb5a0f92b662fe876b49a975bbe835abc506f6535257e67fef31e1d43 WatchSource:0}: Error finding container 5bc02dcfb5a0f92b662fe876b49a975bbe835abc506f6535257e67fef31e1d43: Status 404 returned error can't find the container with id 5bc02dcfb5a0f92b662fe876b49a975bbe835abc506f6535257e67fef31e1d43 Jul 20 19:57:32.718347 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:32.718303 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-64wmx" podStartSLOduration=1.03875595 podStartE2EDuration="6.718292098s" totalImagesPullingTime="5.679536148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:32.71743406 +0000 UTC m=+60.901281792" watchObservedRunningTime="2026-07-20 19:57:32.718292098 +0000 UTC m=+60.902139808" Jul 20 19:57:33.341473 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:33.341432 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:33.431456 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:33.431427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:33.689645 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:33.689162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" event={"ID":"e3287f3b-95d3-4e97-ae29-b23bd27baed4","Type":"ContainerStarted","Data":"5bc02dcfb5a0f92b662fe876b49a975bbe835abc506f6535257e67fef31e1d43"} Jul 20 19:57:33.757479 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:33.757447 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:33.866750 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:33.866724 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:33.961219 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:33.961155 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:34.058406 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.058379 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:34.694669 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.694625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" event={"ID":"e3287f3b-95d3-4e97-ae29-b23bd27baed4","Type":"ContainerStarted","Data":"fce006cb1208eefef434ca7913777a471627d07787571e89889c46d994b327a8"} Jul 20 19:57:34.695199 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.695176 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" Jul 20 19:57:34.700572 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.700549 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" Jul 20 19:57:34.714075 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.714003 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jqcgj" podStartSLOduration=1.542801482 podStartE2EDuration="2.713989187s" totalImagesPullingTime="1.171187705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:34.712417447 +0000 UTC m=+62.896265181" watchObservedRunningTime="2026-07-20 19:57:34.713989187 +0000 UTC m=+62.897836931" Jul 20 19:57:34.723891 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.723869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:34.821931 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.821899 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:34.937692 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.937657 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc586fb79-5lfq9"] Jul 20 19:57:34.953542 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.953370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc586fb79-5lfq9"] Jul 20 19:57:34.953542 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.953493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:34.956055 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.956031 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 19:57:34.956178 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.956031 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 19:57:34.956178 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.956150 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 19:57:34.956541 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.956333 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 19:57:34.956541 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.956389 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 19:57:34.956704 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.956625 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 19:57:34.956763 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.956719 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 19:57:34.957164 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.957142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-oauth-serving-cert\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:34.957248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.957194 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6cw99\"" Jul 20 19:57:34.957248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.957207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-oauth-config\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:34.957248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.957233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sd4q\" (UniqueName: \"kubernetes.io/projected/0f9f967d-4253-4e6f-bb1c-43920e9166fb-kube-api-access-7sd4q\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:34.957358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.957279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-serving-cert\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:34.957358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.957297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-config\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:34.957358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:34.957319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-service-ca\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.058986 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.058194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-oauth-serving-cert\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.058986 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.058307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-oauth-config\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.058986 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.058415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sd4q\" (UniqueName: \"kubernetes.io/projected/0f9f967d-4253-4e6f-bb1c-43920e9166fb-kube-api-access-7sd4q\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.058986 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.058529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-serving-cert\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.058986 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.058574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-config\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.058986 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.058613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-service-ca\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.059696 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.059644 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-oauth-serving-cert\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.059696 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.059690 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-service-ca\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.060773 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.060733 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-config\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.063416 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.062280 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-serving-cert\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.063416 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.062385 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-oauth-config\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.067587 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.067562 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sd4q\" (UniqueName: \"kubernetes.io/projected/0f9f967d-4253-4e6f-bb1c-43920e9166fb-kube-api-access-7sd4q\") pod \"console-6bc586fb79-5lfq9\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.133856 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.133811 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:35.231837 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.231749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:35.263903 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.263872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:35.316126 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.316088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:35.316369 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.316346 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh"] Jul 20 19:57:35.320604 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.320585 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.323238 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.323214 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xdpp7\"" Jul 20 19:57:35.323358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.323240 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 19:57:35.323358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.323223 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 19:57:35.323463 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.323444 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 19:57:35.323530 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.323498 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 19:57:35.323592 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.323564 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 19:57:35.327524 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.327491 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh"] Jul 20 19:57:35.360659 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.360633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mljh4\" (UniqueName: \"kubernetes.io/projected/e3401588-45a4-4a09-94b4-4c4bdf47e006-kube-api-access-mljh4\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.360787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.360677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.360787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.360772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3401588-45a4-4a09-94b4-4c4bdf47e006-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.360912 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.360809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.379467 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.379437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:35.461598 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.461568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.461725 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.461672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3401588-45a4-4a09-94b4-4c4bdf47e006-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.461725 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.461713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.461826 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.461742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mljh4\" (UniqueName: \"kubernetes.io/projected/e3401588-45a4-4a09-94b4-4c4bdf47e006-kube-api-access-mljh4\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.461863 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:35.461836 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 20 19:57:35.461914 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:35.461902 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-tls podName:e3401588-45a4-4a09-94b4-4c4bdf47e006 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:35.961884922 +0000 UTC m=+64.145732645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-ml7mh" (UID: "e3401588-45a4-4a09-94b4-4c4bdf47e006") : secret "prometheus-operator-tls" not found Jul 20 19:57:35.462557 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.462540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3401588-45a4-4a09-94b4-4c4bdf47e006-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.464376 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.464356 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.470736 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.470707 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mljh4\" (UniqueName: \"kubernetes.io/projected/e3401588-45a4-4a09-94b4-4c4bdf47e006-kube-api-access-mljh4\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.800964 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.800934 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:35.901840 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.901813 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:35.928893 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.928870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc586fb79-5lfq9"] Jul 20 19:57:35.931703 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:35.931680 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9f967d_4253_4e6f_bb1c_43920e9166fb.slice/crio-5c537b3c38d678669f6a00a93772e46632934e4dfa38874f93833b19f2dc392f WatchSource:0}: Error finding container 5c537b3c38d678669f6a00a93772e46632934e4dfa38874f93833b19f2dc392f: Status 404 returned error can't find the container with id 5c537b3c38d678669f6a00a93772e46632934e4dfa38874f93833b19f2dc392f Jul 20 19:57:35.964517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.964493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:35.966608 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:35.966590 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3401588-45a4-4a09-94b4-4c4bdf47e006-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ml7mh\" (UID: \"e3401588-45a4-4a09-94b4-4c4bdf47e006\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:36.001348 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:36.001320 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:36.232137 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:36.232112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" Jul 20 19:57:36.365807 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:36.365780 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh"] Jul 20 19:57:36.368873 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:36.368844 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3401588_45a4_4a09_94b4_4c4bdf47e006.slice/crio-16d8627e4a5e7e01609e622c5c18d24e73491d060ac6eabf6c8b92f9b6bf78f5 WatchSource:0}: Error finding container 16d8627e4a5e7e01609e622c5c18d24e73491d060ac6eabf6c8b92f9b6bf78f5: Status 404 returned error can't find the container with id 16d8627e4a5e7e01609e622c5c18d24e73491d060ac6eabf6c8b92f9b6bf78f5 Jul 20 19:57:36.704366 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:36.704329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nnr2" event={"ID":"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4","Type":"ContainerStarted","Data":"33095f13c2a01a32991befe5649c462bcd5ef011cde5f36423b3782de909d67a"} Jul 20 19:57:36.705901 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:36.705867 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" event={"ID":"e3401588-45a4-4a09-94b4-4c4bdf47e006","Type":"ContainerStarted","Data":"16d8627e4a5e7e01609e622c5c18d24e73491d060ac6eabf6c8b92f9b6bf78f5"} Jul 20 19:57:36.707151 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:36.707124 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc586fb79-5lfq9" event={"ID":"0f9f967d-4253-4e6f-bb1c-43920e9166fb","Type":"ContainerStarted","Data":"5c537b3c38d678669f6a00a93772e46632934e4dfa38874f93833b19f2dc392f"} Jul 20 19:57:37.719379 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:37.719345 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:38.082042 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.081950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:38.082042 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.082004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:38.082255 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.082059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:38.084791 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.084759 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 19:57:38.085431 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.085398 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 19:57:38.085431 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.085398 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 19:57:38.094895 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.094877 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 19:57:38.095057 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.095041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1f5a31c-96c1-4057-a6cd-1e358ac4075c-metrics-certs\") pod \"network-metrics-daemon-qf48l\" (UID: \"a1f5a31c-96c1-4057-a6cd-1e358ac4075c\") " pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:38.095143 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.095123 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ff151a4-5119-4434-8578-6a1801e3db65-original-pull-secret\") pod \"global-pull-secret-syncer-kp69t\" (UID: \"7ff151a4-5119-4434-8578-6a1801e3db65\") " pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:38.105061 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.105002 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45dw\" (UniqueName: \"kubernetes.io/projected/231fceb4-e27b-47e3-bd39-46d0cea89970-kube-api-access-c45dw\") pod \"network-check-target-rfznb\" (UID: \"231fceb4-e27b-47e3-bd39-46d0cea89970\") " pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:38.173134 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.173107 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp69t" Jul 20 19:57:38.184772 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.184754 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mmqwm\"" Jul 20 19:57:38.192664 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.192647 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qf48l" Jul 20 19:57:38.192664 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.192660 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qx848\"" Jul 20 19:57:38.200750 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:38.200730 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:39.728728 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.728698 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d66d469cb-dvfsg"] Jul 20 19:57:39.730838 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.730816 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.736741 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.736688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:39.739089 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.739069 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 19:57:39.741655 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.741635 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d66d469cb-dvfsg"] Jul 20 19:57:39.797165 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.797136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-console-config\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.797277 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.797170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-oauth-config\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.797277 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.797196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-trusted-ca-bundle\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.797277 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.797215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-oauth-serving-cert\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.797277 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.797270 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qcdm\" (UniqueName: \"kubernetes.io/projected/18a7d360-e28f-4662-8c00-47174b59af4e-kube-api-access-7qcdm\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.797421 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.797328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-service-ca\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.797421 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.797350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-serving-cert\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.832151 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.832118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:39.897858 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.897830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-service-ca\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.897993 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.897874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-serving-cert\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.897993 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.897901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-console-config\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.897993 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.897923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-oauth-config\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.897993 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.897950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-trusted-ca-bundle\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.897993 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.897973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-oauth-serving-cert\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.898268 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.898004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qcdm\" (UniqueName: \"kubernetes.io/projected/18a7d360-e28f-4662-8c00-47174b59af4e-kube-api-access-7qcdm\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.898648 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.898624 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-service-ca\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.898722 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.898698 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-console-config\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.898891 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.898864 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-oauth-serving-cert\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.899453 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.899432 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-trusted-ca-bundle\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.900863 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.900840 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-serving-cert\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.900954 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.900876 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-oauth-config\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:39.914671 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:39.908667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qcdm\" (UniqueName: \"kubernetes.io/projected/18a7d360-e28f-4662-8c00-47174b59af4e-kube-api-access-7qcdm\") pod \"console-6d66d469cb-dvfsg\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:40.041885 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.041805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:40.725277 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.723728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:40.735330 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.735265 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nnr2" event={"ID":"bf65d6bd-1f97-4528-9f3d-1cc7119be8b4","Type":"ContainerStarted","Data":"df0a37a3e4e6042215c95b26a23f1bcb707fcb86f4832f39c9219b5594586f0a"} Jul 20 19:57:40.737838 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.737756 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" event={"ID":"e3401588-45a4-4a09-94b4-4c4bdf47e006","Type":"ContainerStarted","Data":"5516f33af7dfcaee0d4e6424c604f84357637603838e2e32fe32b4008e53df28"} Jul 20 19:57:40.743134 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.743075 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc586fb79-5lfq9" event={"ID":"0f9f967d-4253-4e6f-bb1c-43920e9166fb","Type":"ContainerStarted","Data":"17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775"} Jul 20 19:57:40.755698 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.755233 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4nnr2" podStartSLOduration=1.004585357 podStartE2EDuration="14.755211462s" totalImagesPullingTime="13.750626105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:57:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:40.753437818 +0000 UTC m=+68.937285550" watchObservedRunningTime="2026-07-20 19:57:40.755211462 +0000 UTC m=+68.939059195" Jul 20 19:57:40.772434 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.772294 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bc586fb79-5lfq9" podStartSLOduration=2.121562894 podStartE2EDuration="6.772256584s" totalImagesPullingTime="4.65069369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:40.770585864 +0000 UTC m=+68.954433596" watchObservedRunningTime="2026-07-20 19:57:40.772256584 +0000 UTC m=+68.956104327" Jul 20 19:57:40.797443 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.797418 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rfznb"] Jul 20 19:57:40.800788 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:40.800756 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231fceb4_e27b_47e3_bd39_46d0cea89970.slice/crio-381495773e61707e029178a714a74ded1f91a91c72001511337f4f2c274be21d WatchSource:0}: Error finding container 381495773e61707e029178a714a74ded1f91a91c72001511337f4f2c274be21d: Status 404 returned error can't find the container with id 381495773e61707e029178a714a74ded1f91a91c72001511337f4f2c274be21d Jul 20 19:57:40.979353 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:40.979310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:41.017536 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.017379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kp69t"] Jul 20 19:57:41.019959 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:41.019926 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff151a4_5119_4434_8578_6a1801e3db65.slice/crio-4b05bf7a1877f969076a86b7cb04e0c6b55f70ccce80be68c6e34eb461701bf2 WatchSource:0}: Error finding container 4b05bf7a1877f969076a86b7cb04e0c6b55f70ccce80be68c6e34eb461701bf2: Status 404 returned error can't find the container with id 4b05bf7a1877f969076a86b7cb04e0c6b55f70ccce80be68c6e34eb461701bf2 Jul 20 19:57:41.021100 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.021080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qf48l"] Jul 20 19:57:41.024221 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.024198 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d66d469cb-dvfsg"] Jul 20 19:57:41.024529 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:41.024504 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f5a31c_96c1_4057_a6cd_1e358ac4075c.slice/crio-9bcb3ead734e7990945309925d33dafd1e3915d6d6b2aa01ebd2c9bcb9d53c0b WatchSource:0}: Error finding container 9bcb3ead734e7990945309925d33dafd1e3915d6d6b2aa01ebd2c9bcb9d53c0b: Status 404 returned error can't find the container with id 9bcb3ead734e7990945309925d33dafd1e3915d6d6b2aa01ebd2c9bcb9d53c0b Jul 20 19:57:41.028880 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:41.028861 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a7d360_e28f_4662_8c00_47174b59af4e.slice/crio-f389fbc2950da19b687d4908eaa6df751272582b9af1372f21415657b5c38df6 WatchSource:0}: Error finding container f389fbc2950da19b687d4908eaa6df751272582b9af1372f21415657b5c38df6: Status 404 returned error can't find the container with id f389fbc2950da19b687d4908eaa6df751272582b9af1372f21415657b5c38df6 Jul 20 19:57:41.749854 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.749815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" event={"ID":"e3401588-45a4-4a09-94b4-4c4bdf47e006","Type":"ContainerStarted","Data":"5745516da3fc48b43d853098960b712916360bf354e311147099457408131762"} Jul 20 19:57:41.751696 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.751669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qf48l" event={"ID":"a1f5a31c-96c1-4057-a6cd-1e358ac4075c","Type":"ContainerStarted","Data":"9bcb3ead734e7990945309925d33dafd1e3915d6d6b2aa01ebd2c9bcb9d53c0b"} Jul 20 19:57:41.753791 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.753753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rfznb" event={"ID":"231fceb4-e27b-47e3-bd39-46d0cea89970","Type":"ContainerStarted","Data":"381495773e61707e029178a714a74ded1f91a91c72001511337f4f2c274be21d"} Jul 20 19:57:41.755731 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.755676 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kp69t" event={"ID":"7ff151a4-5119-4434-8578-6a1801e3db65","Type":"ContainerStarted","Data":"4b05bf7a1877f969076a86b7cb04e0c6b55f70ccce80be68c6e34eb461701bf2"} Jul 20 19:57:41.758441 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.757985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d66d469cb-dvfsg" event={"ID":"18a7d360-e28f-4662-8c00-47174b59af4e","Type":"ContainerStarted","Data":"8e3ecc3ba65e8278fa5a78704f5ec5102f6cf63ce875f5408cd86443b7b56092"} Jul 20 19:57:41.758441 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.758047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d66d469cb-dvfsg" event={"ID":"18a7d360-e28f-4662-8c00-47174b59af4e","Type":"ContainerStarted","Data":"f389fbc2950da19b687d4908eaa6df751272582b9af1372f21415657b5c38df6"} Jul 20 19:57:41.770394 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.770353 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ml7mh" podStartSLOduration=2.562158528 podStartE2EDuration="6.77033278s" totalImagesPullingTime="4.208174252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:41.769289573 +0000 UTC m=+69.953137317" watchObservedRunningTime="2026-07-20 19:57:41.77033278 +0000 UTC m=+69.954180511" Jul 20 19:57:41.791931 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:41.791216 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d66d469cb-dvfsg" podStartSLOduration=2.791199458 podStartE2EDuration="2.791199458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:41.790464092 +0000 UTC m=+69.974311826" watchObservedRunningTime="2026-07-20 19:57:41.791199458 +0000 UTC m=+69.975047189" Jul 20 19:57:42.692326 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:42.692301 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-64wmx" Jul 20 19:57:43.482527 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.482482 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:43.677364 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.677327 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:43.752084 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.752000 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq"] Jul 20 19:57:43.758183 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.758152 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.761068 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.761044 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dlvzb\"" Jul 20 19:57:43.762034 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.761860 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 20 19:57:43.762220 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.762206 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 20 19:57:43.767195 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.767159 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qf48l" event={"ID":"a1f5a31c-96c1-4057-a6cd-1e358ac4075c","Type":"ContainerStarted","Data":"022ac723bcd475270298f7edb40969fb697cec5f44deee680d4630df43bafd26"} Jul 20 19:57:43.775614 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.775594 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q6mz9"] Jul 20 19:57:43.777763 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.777741 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq"] Jul 20 19:57:43.777855 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.777791 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-ggwtb"] Jul 20 19:57:43.777951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.777934 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.780085 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.780066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.783031 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.782991 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 19:57:43.783292 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.783276 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 19:57:43.783405 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.783387 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hqfdn\"" Jul 20 19:57:43.783703 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.783687 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 19:57:43.784191 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.784175 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 20 19:57:43.784380 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.784358 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 20 19:57:43.784449 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.784410 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 20 19:57:43.784504 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.784445 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h9b2p\"" Jul 20 19:57:43.790303 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.790284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:43.794093 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.794071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-ggwtb"] Jul 20 19:57:43.836920 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.836886 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b841b-8b1a-4d82-a96e-763a5bc16c73-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.837073 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.836935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.837073 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.836968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.837073 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.836990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-sys\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837073 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-wtmp\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837267 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-root\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837267 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837197 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-textfile\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837267 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6tj\" (UniqueName: \"kubernetes.io/projected/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-api-access-ft6tj\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.837267 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.837452 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.837452 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b841b-8b1a-4d82-a96e-763a5bc16c73-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.837452 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c58z\" (UniqueName: \"kubernetes.io/projected/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-kube-api-access-4c58z\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.837452 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.837452 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837452 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837733 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.837733 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-tls\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837733 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e74400ff-08ba-4375-b151-4e1f2f64f273-metrics-client-ca\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.837733 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.837540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg4mv\" (UniqueName: \"kubernetes.io/projected/e74400ff-08ba-4375-b151-4e1f2f64f273-kube-api-access-zg4mv\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.938602 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.938571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b841b-8b1a-4d82-a96e-763a5bc16c73-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.938602 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.938615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c58z\" (UniqueName: \"kubernetes.io/projected/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-kube-api-access-4c58z\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.938845 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.938642 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.938845 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.938669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939063 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:43.939043 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 20 19:57:43.939280 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:43.939110 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-tls podName:497b841b-8b1a-4d82-a96e-763a5bc16c73 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:44.439090636 +0000 UTC m=+72.622938369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-ggwtb" (UID: "497b841b-8b1a-4d82-a96e-763a5bc16c73") : secret "kube-state-metrics-tls" not found Jul 20 19:57:43.939280 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939280 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.939280 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-tls\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e74400ff-08ba-4375-b151-4e1f2f64f273-metrics-client-ca\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939297 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-accelerators-collector-config\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg4mv\" (UniqueName: \"kubernetes.io/projected/e74400ff-08ba-4375-b151-4e1f2f64f273-kube-api-access-zg4mv\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/497b841b-8b1a-4d82-a96e-763a5bc16c73-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b841b-8b1a-4d82-a96e-763a5bc16c73-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-sys\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-wtmp\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.939544 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-root\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-textfile\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939608 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-sys\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6tj\" (UniqueName: \"kubernetes.io/projected/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-api-access-ft6tj\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:43.939647 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939709 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/497b841b-8b1a-4d82-a96e-763a5bc16c73-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:43.939748 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-tls podName:5dd93501-5fca-4e39-97f2-0a1e1b3fd18c nodeName:}" failed. No retries permitted until 2026-07-20 19:57:44.439729339 +0000 UTC m=+72.623577073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-ffgcq" (UID: "5dd93501-5fca-4e39-97f2-0a1e1b3fd18c") : secret "openshift-state-metrics-tls" not found Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939799 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-root\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939806 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e74400ff-08ba-4375-b151-4e1f2f64f273-metrics-client-ca\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:43.939892 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 19:57:43.940050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.939969 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-textfile\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.940646 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.940072 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-wtmp\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.940646 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.940104 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.940646 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:43.940124 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-tls podName:e74400ff-08ba-4375-b151-4e1f2f64f273 nodeName:}" failed. No retries permitted until 2026-07-20 19:57:44.439936478 +0000 UTC m=+72.623784204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-tls") pod "node-exporter-q6mz9" (UID: "e74400ff-08ba-4375-b151-4e1f2f64f273") : secret "node-exporter-tls" not found Jul 20 19:57:43.940646 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.940452 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.942297 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.942272 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.942804 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.942783 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.942895 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.942783 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.948074 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.948056 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg4mv\" (UniqueName: \"kubernetes.io/projected/e74400ff-08ba-4375-b151-4e1f2f64f273-kube-api-access-zg4mv\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:43.948306 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.948288 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c58z\" (UniqueName: \"kubernetes.io/projected/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-kube-api-access-4c58z\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:43.949529 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.949347 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6tj\" (UniqueName: \"kubernetes.io/projected/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-api-access-ft6tj\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:43.987824 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:43.987795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:44.092265 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.092199 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:44.203698 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.203663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:44.306095 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.306063 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:44.444614 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.444579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:44.444788 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.444639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-tls\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:44.444788 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.444675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:44.447537 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.447508 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e74400ff-08ba-4375-b151-4e1f2f64f273-node-exporter-tls\") pod \"node-exporter-q6mz9\" (UID: \"e74400ff-08ba-4375-b151-4e1f2f64f273\") " pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:44.447715 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.447590 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/497b841b-8b1a-4d82-a96e-763a5bc16c73-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-ggwtb\" (UID: \"497b841b-8b1a-4d82-a96e-763a5bc16c73\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:44.447715 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.447604 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dd93501-5fca-4e39-97f2-0a1e1b3fd18c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ffgcq\" (UID: \"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:44.456279 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.456251 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:44.670330 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.670300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" Jul 20 19:57:44.694369 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.694332 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q6mz9" Jul 20 19:57:44.700600 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.700579 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" Jul 20 19:57:44.710733 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.710710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:44.803347 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.803303 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:44.807248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.807226 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:57:44.809872 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.809850 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.812401 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.812382 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 19:57:44.812601 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.812583 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 19:57:44.812775 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.812762 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 19:57:44.813091 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.813069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 19:57:44.813330 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.813312 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8zrrl\"" Jul 20 19:57:44.813547 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.813528 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 19:57:44.813719 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.813706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 19:57:44.813886 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.813871 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 19:57:44.814038 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.814009 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 19:57:44.814208 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.814195 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 19:57:44.830941 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.830915 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:57:44.847429 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847537 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847537 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847537 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847675 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847675 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847753 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-web-config\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847753 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847753 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847862 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847862 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnvc2\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-kube-api-access-xnvc2\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.847862 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-out\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.848088 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.847897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.948928 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.948852 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.948928 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.948892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.948943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnvc2\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-kube-api-access-xnvc2\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.948995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-out\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949172 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949488 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949488 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949488 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-web-config\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.949488 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.949307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.950485 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:44.950160 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle podName:ad193cc7-f751-4597-9b0c-03685bfebd4b nodeName:}" failed. No retries permitted until 2026-07-20 19:57:45.450139257 +0000 UTC m=+73.633986987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b") : configmap references non-existent config key: ca-bundle.crt Jul 20 19:57:44.950485 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.950187 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.950660 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.950543 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.950660 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:44.950629 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 20 19:57:44.950767 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:57:44.950711 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls podName:ad193cc7-f751-4597-9b0c-03685bfebd4b nodeName:}" failed. No retries permitted until 2026-07-20 19:57:45.45069446 +0000 UTC m=+73.634542177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b") : secret "alertmanager-main-tls" not found Jul 20 19:57:44.952898 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.952873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.952987 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.952878 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.953323 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.953301 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.954117 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.954089 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.954273 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.954231 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-web-config\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.954464 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.954429 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.954570 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.954551 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.955478 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.955435 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-out\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:44.957750 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:44.957733 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnvc2\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-kube-api-access-xnvc2\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:45.130577 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.130535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:45.264883 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.264802 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:45.265079 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.264911 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:45.270611 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.270589 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:45.331152 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.331108 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:45.356888 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:45.356855 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74400ff_08ba_4375_b151_4e1f2f64f273.slice/crio-84d8e03963c9d28dd7ffa4297337d9040c6bcd6555f9f67e8ee3efab44996095 WatchSource:0}: Error finding container 84d8e03963c9d28dd7ffa4297337d9040c6bcd6555f9f67e8ee3efab44996095: Status 404 returned error can't find the container with id 84d8e03963c9d28dd7ffa4297337d9040c6bcd6555f9f67e8ee3efab44996095 Jul 20 19:57:45.430762 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.430685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:45.454325 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.454263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:45.454407 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.454329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:45.455624 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.455572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:45.458309 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.458253 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:45.513101 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.513071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-ggwtb"] Jul 20 19:57:45.519500 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:45.519467 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497b841b_8b1a_4d82_a96e_763a5bc16c73.slice/crio-9fe5ff9bcbf04bb5767d436d785d50b47345e7770f97b3f24c0774447ddef815 WatchSource:0}: Error finding container 9fe5ff9bcbf04bb5767d436d785d50b47345e7770f97b3f24c0774447ddef815: Status 404 returned error can't find the container with id 9fe5ff9bcbf04bb5767d436d785d50b47345e7770f97b3f24c0774447ddef815 Jul 20 19:57:45.538126 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.538065 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq"] Jul 20 19:57:45.540594 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:45.540568 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd93501_5fca_4e39_97f2_0a1e1b3fd18c.slice/crio-7bb37f2e2670dedc6b9c29f625470c5e30574a32dacc638b63b61b5729cdd2e6 WatchSource:0}: Error finding container 7bb37f2e2670dedc6b9c29f625470c5e30574a32dacc638b63b61b5729cdd2e6: Status 404 returned error can't find the container with id 7bb37f2e2670dedc6b9c29f625470c5e30574a32dacc638b63b61b5729cdd2e6 Jul 20 19:57:45.673847 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.673816 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:45.724996 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.724963 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:57:45.735158 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.735139 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c7885567-5ksx8"] Jul 20 19:57:45.739643 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.739626 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.742358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.742328 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 20 19:57:45.742462 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.742421 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-pvpggfikfons\"" Jul 20 19:57:45.742773 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.742754 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 20 19:57:45.742878 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.742862 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9s4rb\"" Jul 20 19:57:45.743100 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.743083 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 20 19:57:45.743168 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.743118 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 20 19:57:45.743168 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.743085 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 20 19:57:45.755972 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.755948 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c7885567-5ksx8"] Jul 20 19:57:45.756692 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.756671 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:45.778082 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.778057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6mz9" event={"ID":"e74400ff-08ba-4375-b151-4e1f2f64f273","Type":"ContainerStarted","Data":"84d8e03963c9d28dd7ffa4297337d9040c6bcd6555f9f67e8ee3efab44996095"} Jul 20 19:57:45.779512 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.779487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" event={"ID":"497b841b-8b1a-4d82-a96e-763a5bc16c73","Type":"ContainerStarted","Data":"9fe5ff9bcbf04bb5767d436d785d50b47345e7770f97b3f24c0774447ddef815"} Jul 20 19:57:45.783222 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.783189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" event={"ID":"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c","Type":"ContainerStarted","Data":"3b7f8413a4c5ecbc2fd5ea8595d89d1331b2ebe70808861dcaf00d482c3e2647"} Jul 20 19:57:45.783311 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.783242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" event={"ID":"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c","Type":"ContainerStarted","Data":"5a086e0354de0286d2ee124cc72d6d8dc532a44a2cb634241eb565efb8618e7d"} Jul 20 19:57:45.783311 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.783270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" event={"ID":"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c","Type":"ContainerStarted","Data":"7bb37f2e2670dedc6b9c29f625470c5e30574a32dacc638b63b61b5729cdd2e6"} Jul 20 19:57:45.787128 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.787067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qf48l" event={"ID":"a1f5a31c-96c1-4057-a6cd-1e358ac4075c","Type":"ContainerStarted","Data":"1b20f3b882285f2a66a0f0e5800c1d6f8f1b226512b041d44beef095a85b1ec0"} Jul 20 19:57:45.788634 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.788608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rfznb" event={"ID":"231fceb4-e27b-47e3-bd39-46d0cea89970","Type":"ContainerStarted","Data":"a4123cf178783513ab6d713bbb0fb2140cca0e3ddec099cd2029b6f511f90ffc"} Jul 20 19:57:45.788715 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.788667 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:57:45.790236 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.790216 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kp69t" event={"ID":"7ff151a4-5119-4434-8578-6a1801e3db65","Type":"ContainerStarted","Data":"69fb7f1675eaa627c94b396a402df717e00dbc3be509741b8854596a6191b973"} Jul 20 19:57:45.794137 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.794118 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:57:45.811259 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.811211 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qf48l" podStartSLOduration=71.194430843 podStartE2EDuration="1m12.811192995s" totalImagesPullingTime="1.616762152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:45.807313458 +0000 UTC m=+73.991161191" watchObservedRunningTime="2026-07-20 19:57:45.811192995 +0000 UTC m=+73.995040727" Jul 20 19:57:45.829106 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.828972 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rfznb" podStartSLOduration=69.274332991 podStartE2EDuration="1m13.828960046s" totalImagesPullingTime="4.554627055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:45.828051189 +0000 UTC m=+74.011898923" watchObservedRunningTime="2026-07-20 19:57:45.828960046 +0000 UTC m=+74.012807805" Jul 20 19:57:45.846736 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.846699 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kp69t" podStartSLOduration=68.499153382 podStartE2EDuration="1m12.846687152s" totalImagesPullingTime="4.34753377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:45.845807158 +0000 UTC m=+74.029654889" watchObservedRunningTime="2026-07-20 19:57:45.846687152 +0000 UTC m=+74.030534883" Jul 20 19:57:45.856870 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.856851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecfce70d-db11-4f8e-81a8-a178953071f7-metrics-client-ca\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.856951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.856884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5rjc\" (UniqueName: \"kubernetes.io/projected/ecfce70d-db11-4f8e-81a8-a178953071f7-kube-api-access-t5rjc\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.856951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.856904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-grpc-tls\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.856951 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.856921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.857122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.857099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.857301 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.857279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.857386 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.857368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-tls\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.857435 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.857419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.873341 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.873324 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:57:45.875042 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:45.875004 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad193cc7_f751_4597_9b0c_03685bfebd4b.slice/crio-acfd1390d3e5ce916569425ed24c333793bf44a8fc03577ff5bf353181910d6b WatchSource:0}: Error finding container acfd1390d3e5ce916569425ed24c333793bf44a8fc03577ff5bf353181910d6b: Status 404 returned error can't find the container with id acfd1390d3e5ce916569425ed24c333793bf44a8fc03577ff5bf353181910d6b Jul 20 19:57:45.936786 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.936763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:45.958644 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.958768 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958661 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.958768 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958720 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.958768 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-tls\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.958929 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.958929 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecfce70d-db11-4f8e-81a8-a178953071f7-metrics-client-ca\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.958929 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rjc\" (UniqueName: \"kubernetes.io/projected/ecfce70d-db11-4f8e-81a8-a178953071f7-kube-api-access-t5rjc\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.958929 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.958876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-grpc-tls\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.959900 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.959874 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecfce70d-db11-4f8e-81a8-a178953071f7-metrics-client-ca\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.961569 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.961543 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.962086 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.962064 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-grpc-tls\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.962418 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.962372 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.962418 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.962387 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-tls\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.962418 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.962399 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.962570 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.962463 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ecfce70d-db11-4f8e-81a8-a178953071f7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:45.968496 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:45.968472 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5rjc\" (UniqueName: \"kubernetes.io/projected/ecfce70d-db11-4f8e-81a8-a178953071f7-kube-api-access-t5rjc\") pod \"thanos-querier-6c7885567-5ksx8\" (UID: \"ecfce70d-db11-4f8e-81a8-a178953071f7\") " pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:46.037820 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.037758 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:46.048579 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.048556 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:46.208294 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.208158 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c7885567-5ksx8"] Jul 20 19:57:46.441497 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:46.441461 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfce70d_db11_4f8e_81a8_a178953071f7.slice/crio-584b2e9cdebe26437aeaca284eec721bfd0e1debbdb2200aeb2c416a139ccacf WatchSource:0}: Error finding container 584b2e9cdebe26437aeaca284eec721bfd0e1debbdb2200aeb2c416a139ccacf: Status 404 returned error can't find the container with id 584b2e9cdebe26437aeaca284eec721bfd0e1debbdb2200aeb2c416a139ccacf Jul 20 19:57:46.790138 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.790062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:46.795377 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.795346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" event={"ID":"ecfce70d-db11-4f8e-81a8-a178953071f7","Type":"ContainerStarted","Data":"584b2e9cdebe26437aeaca284eec721bfd0e1debbdb2200aeb2c416a139ccacf"} Jul 20 19:57:46.797125 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.797097 2559 generic.go:356] "Generic (PLEG): container finished" podID="e74400ff-08ba-4375-b151-4e1f2f64f273" containerID="b6ce8e458272de7eeae0da25e6d23e6d231b9418e806fb37f09390043d37636e" exitCode=0 Jul 20 19:57:46.797226 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.797180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6mz9" event={"ID":"e74400ff-08ba-4375-b151-4e1f2f64f273","Type":"ContainerDied","Data":"b6ce8e458272de7eeae0da25e6d23e6d231b9418e806fb37f09390043d37636e"} Jul 20 19:57:46.798360 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.798333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerStarted","Data":"acfd1390d3e5ce916569425ed24c333793bf44a8fc03577ff5bf353181910d6b"} Jul 20 19:57:46.890118 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:46.890029 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:47.164371 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.164338 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:47.516202 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.515995 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:47.806428 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.806393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6mz9" event={"ID":"e74400ff-08ba-4375-b151-4e1f2f64f273","Type":"ContainerStarted","Data":"ce21b57103dbf9d381a427f0543916d0cda6a3c3d4afb41e874d1e19eff745af"} Jul 20 19:57:47.806795 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.806457 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q6mz9" event={"ID":"e74400ff-08ba-4375-b151-4e1f2f64f273","Type":"ContainerStarted","Data":"eb8cfba10fece085c11487d4c374fe0f7bed10322a2746e68d8e30d51f462ab6"} Jul 20 19:57:47.808290 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.808263 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerID="63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c" exitCode=0 Jul 20 19:57:47.808397 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.808339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c"} Jul 20 19:57:47.812229 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.812204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" event={"ID":"497b841b-8b1a-4d82-a96e-763a5bc16c73","Type":"ContainerStarted","Data":"e7d4a01c756b37afad1daef274a33b0300e2079577e31ac40678599e824a894e"} Jul 20 19:57:47.812302 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.812257 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" event={"ID":"497b841b-8b1a-4d82-a96e-763a5bc16c73","Type":"ContainerStarted","Data":"ca325bf0226d54b47cefe0ca56205fd12d39ca360b85cd5bcb75e2675c2bef0b"} Jul 20 19:57:47.812302 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.812278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" event={"ID":"497b841b-8b1a-4d82-a96e-763a5bc16c73","Type":"ContainerStarted","Data":"e743df1c397e4bde18582b4a155f4d83d9f91bc42bcaf122e55fc5ee4e4f8c6a"} Jul 20 19:57:47.814982 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.814957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" event={"ID":"5dd93501-5fca-4e39-97f2-0a1e1b3fd18c","Type":"ContainerStarted","Data":"93bf96f8619ef66f486f4bb0a1b7765118bc8fd77322bdd375dd94d2b7aa9514"} Jul 20 19:57:47.825810 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.825638 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q6mz9" podStartSLOduration=3.630032467 podStartE2EDuration="4.825621646s" totalImagesPullingTime="1.123859201s" totalInitContainerRuntime="71.729978ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:47.824595489 +0000 UTC m=+76.008443224" watchObservedRunningTime="2026-07-20 19:57:47.825621646 +0000 UTC m=+76.009469358" Jul 20 19:57:47.861895 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.861845 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ffgcq" podStartSLOduration=3.128016993 podStartE2EDuration="4.861828663s" totalImagesPullingTime="1.73381167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:47.842713187 +0000 UTC m=+76.026560946" watchObservedRunningTime="2026-07-20 19:57:47.861828663 +0000 UTC m=+76.045676397" Jul 20 19:57:47.867952 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:47.863425 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-ggwtb" podStartSLOduration=2.967814755 podStartE2EDuration="4.863406732s" totalImagesPullingTime="1.895591977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:47.860840569 +0000 UTC m=+76.044688303" watchObservedRunningTime="2026-07-20 19:57:47.863406732 +0000 UTC m=+76.047254465" Jul 20 19:57:48.256335 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.256302 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9b69c9676-dtxg4"] Jul 20 19:57:48.260070 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.260048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.263557 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.263511 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 19:57:48.263557 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.263522 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3733p4lldo8tc\"" Jul 20 19:57:48.263736 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.263594 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fg2vj\"" Jul 20 19:57:48.263873 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.263849 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 20 19:57:48.264241 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.264220 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 20 19:57:48.264388 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.264219 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 20 19:57:48.275283 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.275263 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9b69c9676-dtxg4"] Jul 20 19:57:48.383516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.383486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-secret-metrics-server-client-certs\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.383657 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.383525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.383657 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.383545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-audit-log\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.383657 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.383611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-secret-metrics-server-tls\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.383657 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.383650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-metrics-server-audit-profiles\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.383787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.383672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-client-ca-bundle\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.383787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.383717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7gf5\" (UniqueName: \"kubernetes.io/projected/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-kube-api-access-g7gf5\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.477221 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.477157 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:48.484342 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.484315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.484589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.484363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-audit-log\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.484589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.484420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-secret-metrics-server-tls\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.484589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.484447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-metrics-server-audit-profiles\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.484589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.484470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-client-ca-bundle\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.484589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.484536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7gf5\" (UniqueName: \"kubernetes.io/projected/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-kube-api-access-g7gf5\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.484589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.484582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-secret-metrics-server-client-certs\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.485165 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.485123 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.485595 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.485528 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-metrics-server-audit-profiles\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.486322 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.486276 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-audit-log\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.490180 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.489886 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-client-ca-bundle\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.490180 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.490002 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-secret-metrics-server-client-certs\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.490324 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.490193 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx"] Jul 20 19:57:48.490324 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.490314 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-secret-metrics-server-tls\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.494719 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.494662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.498222 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.498162 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7gf5\" (UniqueName: \"kubernetes.io/projected/d33f9822-a6ec-4e4f-9b86-3f88555e3b93-kube-api-access-g7gf5\") pod \"metrics-server-9b69c9676-dtxg4\" (UID: \"d33f9822-a6ec-4e4f-9b86-3f88555e3b93\") " pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.499242 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.498437 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 20 19:57:48.499242 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.498699 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6jqg5\"" Jul 20 19:57:48.500306 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.500252 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx"] Jul 20 19:57:48.549183 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.549161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:48.571780 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.571747 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:57:48.587034 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.586866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwfkj\" (UniqueName: \"kubernetes.io/projected/8663eed9-4611-45fa-b229-23887d938171-kube-api-access-zwfkj\") pod \"monitoring-plugin-7b7b7bc8bf-qf9mx\" (UID: \"8663eed9-4611-45fa-b229-23887d938171\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.587034 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.586947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8663eed9-4611-45fa-b229-23887d938171-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-qf9mx\" (UID: \"8663eed9-4611-45fa-b229-23887d938171\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.688494 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.688066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8663eed9-4611-45fa-b229-23887d938171-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-qf9mx\" (UID: \"8663eed9-4611-45fa-b229-23887d938171\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.688494 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.688202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwfkj\" (UniqueName: \"kubernetes.io/projected/8663eed9-4611-45fa-b229-23887d938171-kube-api-access-zwfkj\") pod \"monitoring-plugin-7b7b7bc8bf-qf9mx\" (UID: \"8663eed9-4611-45fa-b229-23887d938171\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.692280 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.692251 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8663eed9-4611-45fa-b229-23887d938171-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-qf9mx\" (UID: \"8663eed9-4611-45fa-b229-23887d938171\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.701241 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.701214 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwfkj\" (UniqueName: \"kubernetes.io/projected/8663eed9-4611-45fa-b229-23887d938171-kube-api-access-zwfkj\") pod \"monitoring-plugin-7b7b7bc8bf-qf9mx\" (UID: \"8663eed9-4611-45fa-b229-23887d938171\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.735318 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.735292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:48.736123 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.736097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9b69c9676-dtxg4"] Jul 20 19:57:48.819038 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.818939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:48.831722 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.831685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:48.925662 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.925635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:48.999337 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:48.999308 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:49.156634 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:49.156603 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33f9822_a6ec_4e4f_9b86_3f88555e3b93.slice/crio-67eabf3a322f98624291dfc5243e3f0665d37a7f90f8dcb5970b917d26195740 WatchSource:0}: Error finding container 67eabf3a322f98624291dfc5243e3f0665d37a7f90f8dcb5970b917d26195740: Status 404 returned error can't find the container with id 67eabf3a322f98624291dfc5243e3f0665d37a7f90f8dcb5970b917d26195740 Jul 20 19:57:49.339222 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.339185 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d66d469cb-dvfsg"] Jul 20 19:57:49.384792 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.384761 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76785ff7b5-llkm9"] Jul 20 19:57:49.388452 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.388432 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.400132 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.400083 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76785ff7b5-llkm9"] Jul 20 19:57:49.496060 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.495984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-trusted-ca-bundle\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.496060 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.496047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-config\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.496258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.496099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-oauth-config\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.496258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.496135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-service-ca\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.496258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.496169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-oauth-serving-cert\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.496258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.496188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp9lr\" (UniqueName: \"kubernetes.io/projected/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-kube-api-access-rp9lr\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.496258 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.496226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-serving-cert\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.597140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-oauth-config\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.597193 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-service-ca\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.597247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-oauth-serving-cert\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.597278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp9lr\" (UniqueName: \"kubernetes.io/projected/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-kube-api-access-rp9lr\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.597330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-serving-cert\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.597408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-trusted-ca-bundle\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.597448 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-config\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598387 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.598227 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-config\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.598796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.598668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-oauth-serving-cert\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.599399 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.599376 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-trusted-ca-bundle\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.600579 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.600036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-service-ca\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.604101 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.604079 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-serving-cert\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.604248 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.604184 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-oauth-config\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.611985 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.611954 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp9lr\" (UniqueName: \"kubernetes.io/projected/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-kube-api-access-rp9lr\") pod \"console-76785ff7b5-llkm9\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.677313 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.677291 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx"] Jul 20 19:57:49.680894 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:49.680806 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8663eed9_4611_45fa_b229_23887d938171.slice/crio-7406fe3b7c3fd6983cadcff16ca4779d62f69a54cb2d1584669fb10e63a94c79 WatchSource:0}: Error finding container 7406fe3b7c3fd6983cadcff16ca4779d62f69a54cb2d1584669fb10e63a94c79: Status 404 returned error can't find the container with id 7406fe3b7c3fd6983cadcff16ca4779d62f69a54cb2d1584669fb10e63a94c79 Jul 20 19:57:49.699661 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.699637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:49.831089 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.831058 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" event={"ID":"ecfce70d-db11-4f8e-81a8-a178953071f7","Type":"ContainerStarted","Data":"acc8eed6f8c330f75707a44dec94341b3a892b48e3083e1a825ec7fa98b3c239"} Jul 20 19:57:49.831412 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.831145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" event={"ID":"ecfce70d-db11-4f8e-81a8-a178953071f7","Type":"ContainerStarted","Data":"78e8bf4af253bc364483c9db9c8d49b9fd4c734be3031483702c3968bd5ff445"} Jul 20 19:57:49.831412 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.831189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" event={"ID":"ecfce70d-db11-4f8e-81a8-a178953071f7","Type":"ContainerStarted","Data":"c7f9466c490eed1b767f1335cb91cf3359013249b07780e4d68b06462340019c"} Jul 20 19:57:49.832572 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.832548 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" event={"ID":"8663eed9-4611-45fa-b229-23887d938171","Type":"ContainerStarted","Data":"7406fe3b7c3fd6983cadcff16ca4779d62f69a54cb2d1584669fb10e63a94c79"} Jul 20 19:57:49.833583 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.833558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" event={"ID":"d33f9822-a6ec-4e4f-9b86-3f88555e3b93","Type":"ContainerStarted","Data":"67eabf3a322f98624291dfc5243e3f0665d37a7f90f8dcb5970b917d26195740"} Jul 20 19:57:49.836484 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.836465 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerStarted","Data":"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f"} Jul 20 19:57:49.836595 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.836532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerStarted","Data":"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b"} Jul 20 19:57:49.836653 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.836607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerStarted","Data":"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a"} Jul 20 19:57:49.836653 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.836649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerStarted","Data":"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651"} Jul 20 19:57:49.873698 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:49.873674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76785ff7b5-llkm9"] Jul 20 19:57:49.876890 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:49.876868 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea19f3ed_fd02_4787_8d7b_fcd730caa0cf.slice/crio-da9307d04ac6bb600b00ba94b5a74dead6be3b69a50ec90d05c8e85c1db9c470 WatchSource:0}: Error finding container da9307d04ac6bb600b00ba94b5a74dead6be3b69a50ec90d05c8e85c1db9c470: Status 404 returned error can't find the container with id da9307d04ac6bb600b00ba94b5a74dead6be3b69a50ec90d05c8e85c1db9c470 Jul 20 19:57:50.042170 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.042097 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:57:50.203240 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.203206 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:57:50.209598 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.209573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.213586 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.213542 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 19:57:50.213586 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.213576 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 19:57:50.215065 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.215043 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h8gtc\"" Jul 20 19:57:50.215829 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.215806 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-10evlatp5khhg\"" Jul 20 19:57:50.217732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.217172 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 19:57:50.217732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.217600 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 19:57:50.217732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.217621 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 19:57:50.217917 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.217830 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 19:57:50.218051 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.217996 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 19:57:50.218322 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.218302 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 19:57:50.219433 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.219283 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 19:57:50.219743 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.219706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 19:57:50.219944 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.219928 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 19:57:50.220190 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.220174 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 19:57:50.220449 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.220418 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 19:57:50.222066 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.222048 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 19:57:50.231729 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.231708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:57:50.241801 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.241731 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:50.301733 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301658 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config-out\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.301733 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.301923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.301923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301791 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.301923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.301923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.301923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.301923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.301998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-web-config\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302251 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302490 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302490 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302490 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302577 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.302577 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.302526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7pk4\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-kube-api-access-w7pk4\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.403918 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.403884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.403918 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.403924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-web-config\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.404232 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.403948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404365 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7pk4\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-kube-api-access-w7pk4\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config-out\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.405517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.406390 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.404879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.406390 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.405899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.406493 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.406402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.406965 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.406941 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.410717 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.409882 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.413110 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.411722 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.413110 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.412540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.413501 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.413482 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.414133 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.414100 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.415536 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.415261 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.419862 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.419822 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-web-config\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.419944 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.419905 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.420618 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.420553 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.421876 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.421289 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.421876 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.421676 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.421876 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.421696 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.421876 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.421842 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config-out\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.423420 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.423374 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.423611 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.423576 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.428610 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.428573 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7pk4\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-kube-api-access-w7pk4\") pod \"prometheus-k8s-0\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.523415 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.523091 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:57:50.738632 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.738488 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:57:50.846111 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.846068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerStarted","Data":"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31"} Jul 20 19:57:50.847973 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.847821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76785ff7b5-llkm9" event={"ID":"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf","Type":"ContainerStarted","Data":"021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62"} Jul 20 19:57:50.847973 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.847869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76785ff7b5-llkm9" event={"ID":"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf","Type":"ContainerStarted","Data":"da9307d04ac6bb600b00ba94b5a74dead6be3b69a50ec90d05c8e85c1db9c470"} Jul 20 19:57:50.870651 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:50.870449 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76785ff7b5-llkm9" podStartSLOduration=1.8704297429999999 podStartE2EDuration="1.870429743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:50.869909528 +0000 UTC m=+79.053757286" watchObservedRunningTime="2026-07-20 19:57:50.870429743 +0000 UTC m=+79.054277476" Jul 20 19:57:51.582553 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:57:51.582518 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf8a89c_237c_46ea_bd56_bbfed5ab2059.slice/crio-99b2a6a40e0d77bacf31b09c6b429911defdf53cac54c71ca7935be97805e11c WatchSource:0}: Error finding container 99b2a6a40e0d77bacf31b09c6b429911defdf53cac54c71ca7935be97805e11c: Status 404 returned error can't find the container with id 99b2a6a40e0d77bacf31b09c6b429911defdf53cac54c71ca7935be97805e11c Jul 20 19:57:51.845450 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.845382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:51.855073 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.855044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" event={"ID":"ecfce70d-db11-4f8e-81a8-a178953071f7","Type":"ContainerStarted","Data":"2c8cf5a28cdd96ca3e8acd346fa8361675ea21c489bf9b78ce13fe5c49b18ed2"} Jul 20 19:57:51.855358 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.855124 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" event={"ID":"ecfce70d-db11-4f8e-81a8-a178953071f7","Type":"ContainerStarted","Data":"f20f38f2670f3c5d8f9f7a73b379c4a265a1981e42aeb395126fe08f75f8fd23"} Jul 20 19:57:51.856368 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.856339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" event={"ID":"8663eed9-4611-45fa-b229-23887d938171","Type":"ContainerStarted","Data":"4cb2dbd0d1df513fca5300405c0c9a2beff03bb831127105f492e34b8e7cec5a"} Jul 20 19:57:51.856551 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.856494 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:51.857975 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.857952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" event={"ID":"d33f9822-a6ec-4e4f-9b86-3f88555e3b93","Type":"ContainerStarted","Data":"17e83b51736abc3a9804e0dea24967568cb417271420cadb7ee93cda27e837ed"} Jul 20 19:57:51.859777 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.859756 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerID="76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf" exitCode=0 Jul 20 19:57:51.859858 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.859837 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf"} Jul 20 19:57:51.859920 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.859898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerStarted","Data":"99b2a6a40e0d77bacf31b09c6b429911defdf53cac54c71ca7935be97805e11c"} Jul 20 19:57:51.861905 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.861877 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" Jul 20 19:57:51.864156 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.864135 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerStarted","Data":"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea"} Jul 20 19:57:51.873943 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.873902 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf9mx" podStartSLOduration=1.8822312650000002 podStartE2EDuration="3.873889631s" totalImagesPullingTime="1.991658366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:51.872226257 +0000 UTC m=+80.056074001" watchObservedRunningTime="2026-07-20 19:57:51.873889631 +0000 UTC m=+80.057737363" Jul 20 19:57:51.909967 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.909949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:51.948882 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.948830 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" podStartSLOduration=1.432791484 podStartE2EDuration="3.948812965s" totalImagesPullingTime="2.516021481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:51.924462471 +0000 UTC m=+80.108310204" watchObservedRunningTime="2026-07-20 19:57:51.948812965 +0000 UTC m=+80.132660702" Jul 20 19:57:51.978917 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:51.978130 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.873487174 podStartE2EDuration="7.977893307s" totalImagesPullingTime="5.084290004s" totalInitContainerRuntime="20.116129ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:51.973038383 +0000 UTC m=+80.156886107" watchObservedRunningTime="2026-07-20 19:57:51.977893307 +0000 UTC m=+80.161741040" Jul 20 19:57:52.872515 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:52.872481 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" event={"ID":"ecfce70d-db11-4f8e-81a8-a178953071f7","Type":"ContainerStarted","Data":"c68e6628a0c538fd0a1b6fece3e4180c0dd00989f0e749520bfda86905345d43"} Jul 20 19:57:52.873195 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:52.873171 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:52.901134 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:52.900193 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" podStartSLOduration=2.882240849 podStartE2EDuration="7.900174525s" totalImagesPullingTime="5.017933676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:52.899525691 +0000 UTC m=+81.083373450" watchObservedRunningTime="2026-07-20 19:57:52.900174525 +0000 UTC m=+81.084022256" Jul 20 19:57:54.891003 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:54.890972 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c7885567-5ksx8" Jul 20 19:57:55.142054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.141961 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:55.241809 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.241771 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:55.894374 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.894328 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerStarted","Data":"7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee"} Jul 20 19:57:55.894799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.894398 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerStarted","Data":"fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64"} Jul 20 19:57:55.894799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.894425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerStarted","Data":"0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24"} Jul 20 19:57:55.894799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.894451 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerStarted","Data":"4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6"} Jul 20 19:57:55.894799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.894473 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerStarted","Data":"6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf"} Jul 20 19:57:55.894799 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:55.894497 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerStarted","Data":"68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da"} Jul 20 19:57:56.157057 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:56.156968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:56.227399 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:56.227368 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:57:59.699924 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:59.699891 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:59.700437 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:59.699954 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:59.704768 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:59.704750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:59.723992 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:59.723949 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.679642819 podStartE2EDuration="9.723933412s" totalImagesPullingTime="3.014463739s" totalInitContainerRuntime="29.826854ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:57:55.92421769 +0000 UTC m=+84.108065424" watchObservedRunningTime="2026-07-20 19:57:59.723933412 +0000 UTC m=+87.907781143" Jul 20 19:57:59.912663 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:59.912644 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:57:59.959602 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:57:59.959539 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc586fb79-5lfq9"] Jul 20 19:58:00.072834 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:00.072808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:00.174825 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:00.174806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:00.523923 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:00.523896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:58:00.760797 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:00.760767 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:00.862607 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:00.862551 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:00.917859 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:00.917843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:03.877814 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:03.877784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:03.945439 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:03.945404 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:08.572759 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:08.572727 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:58:08.573231 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:08.572802 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:58:14.361068 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:14.361032 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d66d469cb-dvfsg" podUID="18a7d360-e28f-4662-8c00-47174b59af4e" containerName="console" containerID="cri-o://8e3ecc3ba65e8278fa5a78704f5ec5102f6cf63ce875f5408cd86443b7b56092" gracePeriod=15 Jul 20 19:58:14.970693 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:14.970665 2559 generic.go:356] "Generic (PLEG): container finished" podID="18a7d360-e28f-4662-8c00-47174b59af4e" containerID="8e3ecc3ba65e8278fa5a78704f5ec5102f6cf63ce875f5408cd86443b7b56092" exitCode=0 Jul 20 19:58:14.970909 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:14.970742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d66d469cb-dvfsg" event={"ID":"18a7d360-e28f-4662-8c00-47174b59af4e","Type":"ContainerDied","Data":"8e3ecc3ba65e8278fa5a78704f5ec5102f6cf63ce875f5408cd86443b7b56092"} Jul 20 19:58:15.128905 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.128876 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:58:15.206653 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.206629 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-service-ca\") pod \"18a7d360-e28f-4662-8c00-47174b59af4e\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " Jul 20 19:58:15.206784 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.206669 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-oauth-config\") pod \"18a7d360-e28f-4662-8c00-47174b59af4e\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " Jul 20 19:58:15.206784 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.206691 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-oauth-serving-cert\") pod \"18a7d360-e28f-4662-8c00-47174b59af4e\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " Jul 20 19:58:15.206784 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.206724 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-console-config\") pod \"18a7d360-e28f-4662-8c00-47174b59af4e\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " Jul 20 19:58:15.206784 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.206744 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qcdm\" (UniqueName: \"kubernetes.io/projected/18a7d360-e28f-4662-8c00-47174b59af4e-kube-api-access-7qcdm\") pod \"18a7d360-e28f-4662-8c00-47174b59af4e\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " Jul 20 19:58:15.206784 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.206768 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-serving-cert\") pod \"18a7d360-e28f-4662-8c00-47174b59af4e\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " Jul 20 19:58:15.207050 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.206818 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-trusted-ca-bundle\") pod \"18a7d360-e28f-4662-8c00-47174b59af4e\" (UID: \"18a7d360-e28f-4662-8c00-47174b59af4e\") " Jul 20 19:58:15.207122 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.207093 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-service-ca" (OuterVolumeSpecName: "service-ca") pod "18a7d360-e28f-4662-8c00-47174b59af4e" (UID: "18a7d360-e28f-4662-8c00-47174b59af4e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:15.207205 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.207173 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-console-config" (OuterVolumeSpecName: "console-config") pod "18a7d360-e28f-4662-8c00-47174b59af4e" (UID: "18a7d360-e28f-4662-8c00-47174b59af4e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:15.207254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.207184 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18a7d360-e28f-4662-8c00-47174b59af4e" (UID: "18a7d360-e28f-4662-8c00-47174b59af4e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:15.207362 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.207334 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18a7d360-e28f-4662-8c00-47174b59af4e" (UID: "18a7d360-e28f-4662-8c00-47174b59af4e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:15.209055 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.209033 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18a7d360-e28f-4662-8c00-47174b59af4e" (UID: "18a7d360-e28f-4662-8c00-47174b59af4e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:58:15.209142 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.209071 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a7d360-e28f-4662-8c00-47174b59af4e-kube-api-access-7qcdm" (OuterVolumeSpecName: "kube-api-access-7qcdm") pod "18a7d360-e28f-4662-8c00-47174b59af4e" (UID: "18a7d360-e28f-4662-8c00-47174b59af4e"). InnerVolumeSpecName "kube-api-access-7qcdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:58:15.209142 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.209116 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18a7d360-e28f-4662-8c00-47174b59af4e" (UID: "18a7d360-e28f-4662-8c00-47174b59af4e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:58:15.307728 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.307681 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-console-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:15.307728 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.307701 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qcdm\" (UniqueName: \"kubernetes.io/projected/18a7d360-e28f-4662-8c00-47174b59af4e-kube-api-access-7qcdm\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:15.307728 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.307711 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:15.307728 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.307719 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-trusted-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:15.307728 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.307727 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:15.307920 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.307735 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18a7d360-e28f-4662-8c00-47174b59af4e-console-oauth-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:15.307920 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.307742 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18a7d360-e28f-4662-8c00-47174b59af4e-oauth-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:15.976348 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.976322 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d66d469cb-dvfsg" Jul 20 19:58:15.976348 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.976330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d66d469cb-dvfsg" event={"ID":"18a7d360-e28f-4662-8c00-47174b59af4e","Type":"ContainerDied","Data":"f389fbc2950da19b687d4908eaa6df751272582b9af1372f21415657b5c38df6"} Jul 20 19:58:15.976751 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.976381 2559 scope.go:117] "RemoveContainer" containerID="8e3ecc3ba65e8278fa5a78704f5ec5102f6cf63ce875f5408cd86443b7b56092" Jul 20 19:58:15.996191 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:15.996171 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d66d469cb-dvfsg"] Jul 20 19:58:16.000117 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:16.000092 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d66d469cb-dvfsg"] Jul 20 19:58:16.360996 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:16.360942 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a7d360-e28f-4662-8c00-47174b59af4e" path="/var/lib/kubelet/pods/18a7d360-e28f-4662-8c00-47174b59af4e/volumes" Jul 20 19:58:16.801161 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:16.801137 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rfznb" Jul 20 19:58:18.888964 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:18.888935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:18.951605 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:18.951575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:19.705005 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:19.704976 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:19.839712 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:19.839690 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:22.022918 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:22.022888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:24.985361 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:24.985317 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bc586fb79-5lfq9" podUID="0f9f967d-4253-4e6f-bb1c-43920e9166fb" containerName="console" containerID="cri-o://17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775" gracePeriod=15 Jul 20 19:58:25.226925 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.226902 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:58:25.378240 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378214 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-oauth-config\") pod \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " Jul 20 19:58:25.378402 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378272 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-oauth-serving-cert\") pod \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " Jul 20 19:58:25.378402 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378306 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-config\") pod \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " Jul 20 19:58:25.378402 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378331 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-serving-cert\") pod \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " Jul 20 19:58:25.378402 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378356 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-service-ca\") pod \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " Jul 20 19:58:25.378402 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378388 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sd4q\" (UniqueName: \"kubernetes.io/projected/0f9f967d-4253-4e6f-bb1c-43920e9166fb-kube-api-access-7sd4q\") pod \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\" (UID: \"0f9f967d-4253-4e6f-bb1c-43920e9166fb\") " Jul 20 19:58:25.378736 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378703 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-config" (OuterVolumeSpecName: "console-config") pod "0f9f967d-4253-4e6f-bb1c-43920e9166fb" (UID: "0f9f967d-4253-4e6f-bb1c-43920e9166fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:25.378736 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378716 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f9f967d-4253-4e6f-bb1c-43920e9166fb" (UID: "0f9f967d-4253-4e6f-bb1c-43920e9166fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:25.378848 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.378719 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f9f967d-4253-4e6f-bb1c-43920e9166fb" (UID: "0f9f967d-4253-4e6f-bb1c-43920e9166fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:58:25.380709 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.380677 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f9f967d-4253-4e6f-bb1c-43920e9166fb" (UID: "0f9f967d-4253-4e6f-bb1c-43920e9166fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:58:25.380709 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.380665 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9f967d-4253-4e6f-bb1c-43920e9166fb-kube-api-access-7sd4q" (OuterVolumeSpecName: "kube-api-access-7sd4q") pod "0f9f967d-4253-4e6f-bb1c-43920e9166fb" (UID: "0f9f967d-4253-4e6f-bb1c-43920e9166fb"). InnerVolumeSpecName "kube-api-access-7sd4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:58:25.380833 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.380734 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f9f967d-4253-4e6f-bb1c-43920e9166fb" (UID: "0f9f967d-4253-4e6f-bb1c-43920e9166fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:58:25.479842 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.479805 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-oauth-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:25.479842 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.479839 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:25.479842 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.479848 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:25.480009 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.479856 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9f967d-4253-4e6f-bb1c-43920e9166fb-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:25.480009 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.479864 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sd4q\" (UniqueName: \"kubernetes.io/projected/0f9f967d-4253-4e6f-bb1c-43920e9166fb-kube-api-access-7sd4q\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:25.480009 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.479873 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f9f967d-4253-4e6f-bb1c-43920e9166fb-console-oauth-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:58:25.881418 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:25.881394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:26.008221 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.008193 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:26.020347 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.020324 2559 generic.go:356] "Generic (PLEG): container finished" podID="0f9f967d-4253-4e6f-bb1c-43920e9166fb" containerID="17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775" exitCode=0 Jul 20 19:58:26.020437 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.020354 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc586fb79-5lfq9" event={"ID":"0f9f967d-4253-4e6f-bb1c-43920e9166fb","Type":"ContainerDied","Data":"17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775"} Jul 20 19:58:26.020437 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.020375 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc586fb79-5lfq9" Jul 20 19:58:26.020437 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.020389 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc586fb79-5lfq9" event={"ID":"0f9f967d-4253-4e6f-bb1c-43920e9166fb","Type":"ContainerDied","Data":"5c537b3c38d678669f6a00a93772e46632934e4dfa38874f93833b19f2dc392f"} Jul 20 19:58:26.020437 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.020407 2559 scope.go:117] "RemoveContainer" containerID="17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775" Jul 20 19:58:26.029010 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.028995 2559 scope.go:117] "RemoveContainer" containerID="17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775" Jul 20 19:58:26.029286 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:58:26.029269 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775\": container with ID starting with 17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775 not found: ID does not exist" containerID="17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775" Jul 20 19:58:26.029341 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.029293 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775"} err="failed to get container status \"17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775\": rpc error: code = NotFound desc = could not find container \"17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775\": container with ID starting with 17d5a6f9dd23d1762003ca6ce5faeeb8b7cbdf6f3a2a84e396be43db93392775 not found: ID does not exist" Jul 20 19:58:26.040773 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.040756 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc586fb79-5lfq9"] Jul 20 19:58:26.044229 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.044200 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bc586fb79-5lfq9"] Jul 20 19:58:26.068811 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.068788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:26.361461 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:26.361407 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f9f967d-4253-4e6f-bb1c-43920e9166fb" path="/var/lib/kubelet/pods/0f9f967d-4253-4e6f-bb1c-43920e9166fb/volumes" Jul 20 19:58:28.577117 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:28.577091 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:58:28.580780 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:28.580760 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9b69c9676-dtxg4" Jul 20 19:58:34.871725 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:34.871692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:50.523751 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:50.523718 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:58:50.542542 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:50.542521 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:58:51.137192 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:51.137169 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:58:54.076241 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:54.076211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:58:58.212418 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:58:58.212384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:03.193751 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:03.193719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:03.393028 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:03.392968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:04.247670 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:04.247639 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:59:04.248057 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:04.247917 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="alertmanager" containerID="cri-o://18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651" gracePeriod=120 Jul 20 19:59:04.248057 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:04.247981 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-metric" containerID="cri-o://545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31" gracePeriod=120 Jul 20 19:59:04.248190 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:04.248045 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="prom-label-proxy" containerID="cri-o://78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea" gracePeriod=120 Jul 20 19:59:04.248190 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:04.248079 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy" containerID="cri-o://28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f" gracePeriod=120 Jul 20 19:59:04.248190 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:04.248081 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="config-reloader" containerID="cri-o://434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a" gracePeriod=120 Jul 20 19:59:04.248190 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:04.248061 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-web" containerID="cri-o://265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b" gracePeriod=120 Jul 20 19:59:05.179970 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.179934 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerID="78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea" exitCode=0 Jul 20 19:59:05.179970 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.179966 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerID="28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f" exitCode=0 Jul 20 19:59:05.179970 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.179973 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerID="434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a" exitCode=0 Jul 20 19:59:05.179970 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.179978 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerID="18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651" exitCode=0 Jul 20 19:59:05.180245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.180003 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea"} Jul 20 19:59:05.180245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.180079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f"} Jul 20 19:59:05.180245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.180105 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a"} Jul 20 19:59:05.180245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.180140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651"} Jul 20 19:59:05.482691 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.482669 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:05.586009 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.585983 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-cluster-tls-config\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586009 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586032 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586051 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586072 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-volume\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586105 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-web-config\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586134 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-metrics-client-ca\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-out\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586221 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-main-db\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586244 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-tls-assets\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586284 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586316 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586341 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.586589 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.586396 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnvc2\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-kube-api-access-xnvc2\") pod \"ad193cc7-f751-4597-9b0c-03685bfebd4b\" (UID: \"ad193cc7-f751-4597-9b0c-03685bfebd4b\") " Jul 20 19:59:05.587315 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.587040 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:05.587315 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.587055 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:05.587661 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.587360 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:05.589709 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.589668 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:05.590212 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.590185 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:59:05.590212 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.590195 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-out" (OuterVolumeSpecName: "config-out") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:05.590367 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.590234 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-volume" (OuterVolumeSpecName: "config-volume") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:05.590440 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.590356 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-kube-api-access-xnvc2" (OuterVolumeSpecName: "kube-api-access-xnvc2") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "kube-api-access-xnvc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:59:05.590496 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.590437 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:05.590550 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.590535 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:05.590632 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.590608 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:05.593965 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.593946 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:05.600164 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.600144 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-web-config" (OuterVolumeSpecName: "web-config") pod "ad193cc7-f751-4597-9b0c-03685bfebd4b" (UID: "ad193cc7-f751-4597-9b0c-03685bfebd4b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:05.687767 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687741 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-main-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687767 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687763 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687773 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687782 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnvc2\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-kube-api-access-xnvc2\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687791 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-cluster-tls-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687800 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687808 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687817 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-volume\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687842 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad193cc7-f751-4597-9b0c-03685bfebd4b-web-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687850 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad193cc7-f751-4597-9b0c-03685bfebd4b-metrics-client-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687859 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-config-out\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687867 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad193cc7-f751-4597-9b0c-03685bfebd4b-alertmanager-main-db\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:05.687879 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:05.687876 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad193cc7-f751-4597-9b0c-03685bfebd4b-tls-assets\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:06.187212 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.187181 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerID="545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31" exitCode=0 Jul 20 19:59:06.187212 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.187209 2559 generic.go:356] "Generic (PLEG): container finished" podID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerID="265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b" exitCode=0 Jul 20 19:59:06.187388 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.187261 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.187388 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.187272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31"} Jul 20 19:59:06.187388 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.187339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b"} Jul 20 19:59:06.187388 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.187367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad193cc7-f751-4597-9b0c-03685bfebd4b","Type":"ContainerDied","Data":"acfd1390d3e5ce916569425ed24c333793bf44a8fc03577ff5bf353181910d6b"} Jul 20 19:59:06.187517 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.187400 2559 scope.go:117] "RemoveContainer" containerID="78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea" Jul 20 19:59:06.195832 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.195758 2559 scope.go:117] "RemoveContainer" containerID="545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31" Jul 20 19:59:06.204649 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.204633 2559 scope.go:117] "RemoveContainer" containerID="28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f" Jul 20 19:59:06.211618 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.211600 2559 scope.go:117] "RemoveContainer" containerID="265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b" Jul 20 19:59:06.211919 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.211899 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:59:06.215235 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.215217 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:59:06.218465 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.218438 2559 scope.go:117] "RemoveContainer" containerID="434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a" Jul 20 19:59:06.224902 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.224884 2559 scope.go:117] "RemoveContainer" containerID="18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651" Jul 20 19:59:06.231366 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.231351 2559 scope.go:117] "RemoveContainer" containerID="63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c" Jul 20 19:59:06.238255 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.238242 2559 scope.go:117] "RemoveContainer" containerID="78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea" Jul 20 19:59:06.238509 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:06.238493 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea\": container with ID starting with 78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea not found: ID does not exist" containerID="78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea" Jul 20 19:59:06.238554 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.238519 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea"} err="failed to get container status \"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea\": rpc error: code = NotFound desc = could not find container \"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea\": container with ID starting with 78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea not found: ID does not exist" Jul 20 19:59:06.238554 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.238536 2559 scope.go:117] "RemoveContainer" containerID="545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31" Jul 20 19:59:06.238756 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:06.238738 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31\": container with ID starting with 545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31 not found: ID does not exist" containerID="545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31" Jul 20 19:59:06.238792 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.238762 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31"} err="failed to get container status \"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31\": rpc error: code = NotFound desc = could not find container \"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31\": container with ID starting with 545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31 not found: ID does not exist" Jul 20 19:59:06.238792 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.238777 2559 scope.go:117] "RemoveContainer" containerID="28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f" Jul 20 19:59:06.238977 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:06.238964 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f\": container with ID starting with 28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f not found: ID does not exist" containerID="28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f" Jul 20 19:59:06.239060 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.238981 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f"} err="failed to get container status \"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f\": rpc error: code = NotFound desc = could not find container \"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f\": container with ID starting with 28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f not found: ID does not exist" Jul 20 19:59:06.239060 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.238992 2559 scope.go:117] "RemoveContainer" containerID="265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b" Jul 20 19:59:06.239201 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:06.239188 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b\": container with ID starting with 265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b not found: ID does not exist" containerID="265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b" Jul 20 19:59:06.239239 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239204 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b"} err="failed to get container status \"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b\": rpc error: code = NotFound desc = could not find container \"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b\": container with ID starting with 265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b not found: ID does not exist" Jul 20 19:59:06.239239 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239215 2559 scope.go:117] "RemoveContainer" containerID="434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a" Jul 20 19:59:06.239404 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:06.239389 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a\": container with ID starting with 434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a not found: ID does not exist" containerID="434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a" Jul 20 19:59:06.239444 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239407 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a"} err="failed to get container status \"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a\": rpc error: code = NotFound desc = could not find container \"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a\": container with ID starting with 434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a not found: ID does not exist" Jul 20 19:59:06.239444 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239418 2559 scope.go:117] "RemoveContainer" containerID="18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651" Jul 20 19:59:06.239639 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:06.239620 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651\": container with ID starting with 18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651 not found: ID does not exist" containerID="18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651" Jul 20 19:59:06.239696 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239647 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651"} err="failed to get container status \"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651\": rpc error: code = NotFound desc = could not find container \"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651\": container with ID starting with 18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651 not found: ID does not exist" Jul 20 19:59:06.239696 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239669 2559 scope.go:117] "RemoveContainer" containerID="63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c" Jul 20 19:59:06.239876 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:06.239862 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c\": container with ID starting with 63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c not found: ID does not exist" containerID="63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c" Jul 20 19:59:06.239909 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239880 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c"} err="failed to get container status \"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c\": rpc error: code = NotFound desc = could not find container \"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c\": container with ID starting with 63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c not found: ID does not exist" Jul 20 19:59:06.239909 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.239894 2559 scope.go:117] "RemoveContainer" containerID="78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea" Jul 20 19:59:06.240103 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240076 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea"} err="failed to get container status \"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea\": rpc error: code = NotFound desc = could not find container \"78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea\": container with ID starting with 78a2e3b60084f42dca9e069fc2c831135451eab822d26e8f7c94ecb2caa621ea not found: ID does not exist" Jul 20 19:59:06.240103 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240104 2559 scope.go:117] "RemoveContainer" containerID="545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31" Jul 20 19:59:06.240294 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240279 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31"} err="failed to get container status \"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31\": rpc error: code = NotFound desc = could not find container \"545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31\": container with ID starting with 545f54f0ec82f2d177e3349d0120f9afe6f0ce63b9a6ccfbfd2fef4b3a990a31 not found: ID does not exist" Jul 20 19:59:06.240335 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240295 2559 scope.go:117] "RemoveContainer" containerID="28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f" Jul 20 19:59:06.240477 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240461 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f"} err="failed to get container status \"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f\": rpc error: code = NotFound desc = could not find container \"28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f\": container with ID starting with 28b1417a724b4487a794b5f319b668701ea2b7e01a04f7b27c65fa913c22fd7f not found: ID does not exist" Jul 20 19:59:06.240537 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240479 2559 scope.go:117] "RemoveContainer" containerID="265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b" Jul 20 19:59:06.240685 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240671 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b"} err="failed to get container status \"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b\": rpc error: code = NotFound desc = could not find container \"265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b\": container with ID starting with 265062b4bd652aed659a7db55d418dd06c30ee9d165640f6a1cebd2efa19fe6b not found: ID does not exist" Jul 20 19:59:06.240727 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240686 2559 scope.go:117] "RemoveContainer" containerID="434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a" Jul 20 19:59:06.240855 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240839 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a"} err="failed to get container status \"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a\": rpc error: code = NotFound desc = could not find container \"434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a\": container with ID starting with 434b0c91a9fa2cd3ad869bdff018c06ef2533bd1e068c3edae1daa2d634af66a not found: ID does not exist" Jul 20 19:59:06.240918 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.240856 2559 scope.go:117] "RemoveContainer" containerID="18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651" Jul 20 19:59:06.241051 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.241037 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651"} err="failed to get container status \"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651\": rpc error: code = NotFound desc = could not find container \"18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651\": container with ID starting with 18da9994149b95a5065f4da07a444d074ae7f42ea1fb7c1e4453e9fc1d17b651 not found: ID does not exist" Jul 20 19:59:06.241100 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.241052 2559 scope.go:117] "RemoveContainer" containerID="63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c" Jul 20 19:59:06.241245 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.241195 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c"} err="failed to get container status \"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c\": rpc error: code = NotFound desc = could not find container \"63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c\": container with ID starting with 63abf5d975919c5d17bfe2d3eebf08ebaf9a862c68b03c298236e0bbcb57aa0c not found: ID does not exist" Jul 20 19:59:06.243316 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243297 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:59:06.243575 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243563 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="alertmanager" Jul 20 19:59:06.243613 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243576 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="alertmanager" Jul 20 19:59:06.243613 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243588 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="prom-label-proxy" Jul 20 19:59:06.243613 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243593 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="prom-label-proxy" Jul 20 19:59:06.243613 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243601 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="config-reloader" Jul 20 19:59:06.243613 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243605 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="config-reloader" Jul 20 19:59:06.243613 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243611 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243616 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243627 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a7d360-e28f-4662-8c00-47174b59af4e" containerName="console" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243632 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a7d360-e28f-4662-8c00-47174b59af4e" containerName="console" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243638 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-web" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243642 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-web" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243651 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9f967d-4253-4e6f-bb1c-43920e9166fb" containerName="console" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243656 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9f967d-4253-4e6f-bb1c-43920e9166fb" containerName="console" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243665 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-metric" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243669 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-metric" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243675 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="init-config-reloader" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243680 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="init-config-reloader" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243737 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-web" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243747 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="prom-label-proxy" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243753 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f9f967d-4253-4e6f-bb1c-43920e9166fb" containerName="console" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243759 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a7d360-e28f-4662-8c00-47174b59af4e" containerName="console" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243764 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243770 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="config-reloader" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243774 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="alertmanager" Jul 20 19:59:06.243779 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.243780 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" containerName="kube-rbac-proxy-metric" Jul 20 19:59:06.246919 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.246905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.250817 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.250796 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 19:59:06.251128 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251110 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8zrrl\"" Jul 20 19:59:06.251525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251226 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 19:59:06.251525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251173 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 19:59:06.251525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251152 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 19:59:06.251525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251174 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 19:59:06.251525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251200 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 19:59:06.251525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251342 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 19:59:06.251525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.251177 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 19:59:06.255840 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.255823 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 19:59:06.262819 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.262799 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:59:06.292469 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292563 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292563 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292563 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292662 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-config-volume\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292662 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-web-config\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292662 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdjgj\" (UniqueName: \"kubernetes.io/projected/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-kube-api-access-kdjgj\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292749 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-tls-assets\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292749 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292749 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-config-out\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292749 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292858 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.292858 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.292809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.361103 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.361081 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad193cc7-f751-4597-9b0c-03685bfebd4b" path="/var/lib/kubelet/pods/ad193cc7-f751-4597-9b0c-03685bfebd4b/volumes" Jul 20 19:59:06.393485 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdjgj\" (UniqueName: \"kubernetes.io/projected/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-kube-api-access-kdjgj\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393538 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-tls-assets\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393538 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393609 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-config-out\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393609 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393570 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393609 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393727 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393727 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393684 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393727 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393904 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393904 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393760 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393904 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-config-volume\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.393904 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.393830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-web-config\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.394133 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.394080 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.394924 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.394899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.395334 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.395290 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.396966 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.396921 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.397079 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.397002 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.397254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.397230 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-web-config\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.397351 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.397304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-config-out\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.397351 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.397341 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.397459 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.397355 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-tls-assets\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.397459 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.397341 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-config-volume\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.397845 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.397822 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.398267 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.398250 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.401972 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.401954 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdjgj\" (UniqueName: \"kubernetes.io/projected/686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980-kube-api-access-kdjgj\") pod \"alertmanager-main-0\" (UID: \"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.557647 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.557585 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 19:59:06.693731 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:06.693701 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 19:59:06.697083 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:59:06.697048 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686c7b8d_e7f4_46bf_bcb0_4ad0a2e27980.slice/crio-cbda719741dfa868a0314d91c1a9788426244bd1da90493b284cb4be9dbc965f WatchSource:0}: Error finding container cbda719741dfa868a0314d91c1a9788426244bd1da90493b284cb4be9dbc965f: Status 404 returned error can't find the container with id cbda719741dfa868a0314d91c1a9788426244bd1da90493b284cb4be9dbc965f Jul 20 19:59:07.192297 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:07.192261 2559 generic.go:356] "Generic (PLEG): container finished" podID="686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980" containerID="969fdd56677121d3ae4df9645118662c9f5ce0b2ee17cc002bd5beb1f73700f1" exitCode=0 Jul 20 19:59:07.192454 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:07.192344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerDied","Data":"969fdd56677121d3ae4df9645118662c9f5ce0b2ee17cc002bd5beb1f73700f1"} Jul 20 19:59:07.192454 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:07.192444 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerStarted","Data":"cbda719741dfa868a0314d91c1a9788426244bd1da90493b284cb4be9dbc965f"} Jul 20 19:59:08.201448 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.201417 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerStarted","Data":"53f472f3687af4dba1812517f68125cbf903fdc76c082027cad9cbfc6b06a724"} Jul 20 19:59:08.201796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.201482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerStarted","Data":"1c9a3a928485aeca0ccfb292695ebd6ea5460ea8d703e7a7dd40b83a5cc5e5c5"} Jul 20 19:59:08.201796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.201515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerStarted","Data":"94d00f7b0c6b566839affa553c3d5f86c4ceeef86e3c5e1905cfd8601842b449"} Jul 20 19:59:08.201796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.201543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerStarted","Data":"5c345d748be62e71d0fe637be7e7a835960090581c263f372e106b7ffeb8bc32"} Jul 20 19:59:08.201796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.201565 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerStarted","Data":"7386f40300e5d7159fb2c25658d057be673289d13b9c9b50454ebb810af1cdaa"} Jul 20 19:59:08.201796 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.201616 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980","Type":"ContainerStarted","Data":"eba1c06852fa9e97c8f551d5f3711e7393d391519cf8cfa24f201b4277516ca4"} Jul 20 19:59:08.237127 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.237078 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.221864733 podStartE2EDuration="2.237061643s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.19691ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:08.235036234 +0000 UTC m=+156.418883958" watchObservedRunningTime="2026-07-20 19:59:08.237061643 +0000 UTC m=+156.420909374" Jul 20 19:59:08.616095 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.615993 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:59:08.616397 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.616364 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="prometheus" containerID="cri-o://68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da" gracePeriod=600 Jul 20 19:59:08.616537 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.616376 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="thanos-sidecar" containerID="cri-o://4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6" gracePeriod=600 Jul 20 19:59:08.616610 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.616372 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy" containerID="cri-o://fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64" gracePeriod=600 Jul 20 19:59:08.616666 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.616401 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee" gracePeriod=600 Jul 20 19:59:08.616766 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.616409 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="config-reloader" containerID="cri-o://6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf" gracePeriod=600 Jul 20 19:59:08.616880 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:08.616419 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-web" containerID="cri-o://0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24" gracePeriod=600 Jul 20 19:59:09.209732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209697 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerID="7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee" exitCode=0 Jul 20 19:59:09.209732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209722 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerID="fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64" exitCode=0 Jul 20 19:59:09.209732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209728 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerID="4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6" exitCode=0 Jul 20 19:59:09.209732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209734 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerID="6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf" exitCode=0 Jul 20 19:59:09.209732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209739 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerID="68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da" exitCode=0 Jul 20 19:59:09.210288 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209771 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee"} Jul 20 19:59:09.210288 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209853 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64"} Jul 20 19:59:09.210288 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6"} Jul 20 19:59:09.210288 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209936 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf"} Jul 20 19:59:09.210288 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.209975 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da"} Jul 20 19:59:09.863624 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.863602 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:09.927847 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927773 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-db\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.927847 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927809 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-2\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.927847 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927834 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-grpc-tls\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.927847 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927849 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-tls-assets\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927886 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-metrics-client-ca\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927906 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-trusted-ca-bundle\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927925 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-0\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927944 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config-out\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927969 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-kubelet-serving-ca-bundle\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.927992 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-serving-certs-ca-bundle\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928046 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-tls\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928084 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-web-config\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928148 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928108 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7pk4\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-kube-api-access-w7pk4\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928164 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928204 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928217 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928296 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-kube-rbac-proxy\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928312 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928321 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-metrics-client-certs\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928351 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-1\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928552 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928401 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-thanos-prometheus-http-client-file\") pod \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\" (UID: \"eaf8a89c-237c-46ea-bd56-bbfed5ab2059\") " Jul 20 19:59:09.928944 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928773 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:09.928944 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928930 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:09.929076 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928948 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-metrics-client-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:09.929076 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.928964 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:09.929250 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.929223 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:09.929567 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.929364 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:09.930067 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.929721 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:09.930859 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.930344 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:09.930859 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.930711 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:09.931314 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.931276 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config" (OuterVolumeSpecName: "config") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.931426 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.931323 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.933094 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.933067 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.934175 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.934135 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:59:09.934175 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.934143 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.934339 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.934218 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config-out" (OuterVolumeSpecName: "config-out") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:59:09.934339 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.934216 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-kube-api-access-w7pk4" (OuterVolumeSpecName: "kube-api-access-w7pk4") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "kube-api-access-w7pk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:59:09.934339 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.934301 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.934502 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.934410 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.934560 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.934544 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.935061 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.935038 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:09.943935 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:09.943913 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-web-config" (OuterVolumeSpecName: "web-config") pod "eaf8a89c-237c-46ea-bd56-bbfed5ab2059" (UID: "eaf8a89c-237c-46ea-bd56-bbfed5ab2059"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:10.029506 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029478 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029506 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029502 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-web-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029506 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029512 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7pk4\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-kube-api-access-w7pk4\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029523 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029533 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029542 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029550 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-kube-rbac-proxy\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029559 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-metrics-client-certs\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029568 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029576 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029585 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-db\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029593 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-secret-grpc-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029600 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-tls-assets\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029607 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029615 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029622 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-config-out\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.029688 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.029630 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf8a89c-237c-46ea-bd56-bbfed5ab2059-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:10.217126 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.217039 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerID="0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24" exitCode=0 Jul 20 19:59:10.217126 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.217122 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.217527 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.217120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24"} Jul 20 19:59:10.217527 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.217213 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eaf8a89c-237c-46ea-bd56-bbfed5ab2059","Type":"ContainerDied","Data":"99b2a6a40e0d77bacf31b09c6b429911defdf53cac54c71ca7935be97805e11c"} Jul 20 19:59:10.217527 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.217244 2559 scope.go:117] "RemoveContainer" containerID="7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee" Jul 20 19:59:10.225521 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.225503 2559 scope.go:117] "RemoveContainer" containerID="fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64" Jul 20 19:59:10.233873 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.233854 2559 scope.go:117] "RemoveContainer" containerID="0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24" Jul 20 19:59:10.240795 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.240781 2559 scope.go:117] "RemoveContainer" containerID="4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6" Jul 20 19:59:10.242442 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.242424 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:59:10.246872 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.246852 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:59:10.248271 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.248253 2559 scope.go:117] "RemoveContainer" containerID="6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf" Jul 20 19:59:10.254738 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.254722 2559 scope.go:117] "RemoveContainer" containerID="68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da" Jul 20 19:59:10.261426 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.261412 2559 scope.go:117] "RemoveContainer" containerID="76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf" Jul 20 19:59:10.267886 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.267871 2559 scope.go:117] "RemoveContainer" containerID="7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee" Jul 20 19:59:10.268152 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:10.268135 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee\": container with ID starting with 7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee not found: ID does not exist" containerID="7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee" Jul 20 19:59:10.268235 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268163 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee"} err="failed to get container status \"7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee\": rpc error: code = NotFound desc = could not find container \"7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee\": container with ID starting with 7e43fed7b17d9a4c4fdb62fdb4f1cbf0e62fe7fecfcb5f64a8acbc82a2bfc2ee not found: ID does not exist" Jul 20 19:59:10.268235 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268186 2559 scope.go:117] "RemoveContainer" containerID="fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64" Jul 20 19:59:10.268424 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:10.268408 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64\": container with ID starting with fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64 not found: ID does not exist" containerID="fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64" Jul 20 19:59:10.268458 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268432 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64"} err="failed to get container status \"fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64\": rpc error: code = NotFound desc = could not find container \"fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64\": container with ID starting with fda5f1bdaa52c6ed8775448ec92786b7a9689828d8d086777e3622274799df64 not found: ID does not exist" Jul 20 19:59:10.268458 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268447 2559 scope.go:117] "RemoveContainer" containerID="0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24" Jul 20 19:59:10.268678 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:10.268661 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24\": container with ID starting with 0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24 not found: ID does not exist" containerID="0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24" Jul 20 19:59:10.268718 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268686 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24"} err="failed to get container status \"0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24\": rpc error: code = NotFound desc = could not find container \"0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24\": container with ID starting with 0a49b92415333c58d514f6b760193eaee88e2531a5f953c7dd15b42ed9f0ec24 not found: ID does not exist" Jul 20 19:59:10.268718 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268701 2559 scope.go:117] "RemoveContainer" containerID="4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6" Jul 20 19:59:10.268904 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:10.268887 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6\": container with ID starting with 4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6 not found: ID does not exist" containerID="4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6" Jul 20 19:59:10.268937 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268909 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6"} err="failed to get container status \"4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6\": rpc error: code = NotFound desc = could not find container \"4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6\": container with ID starting with 4469c59baa6e1cc970c524554f788505e5eca5e22e39357988c89223b6abc5f6 not found: ID does not exist" Jul 20 19:59:10.268937 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.268923 2559 scope.go:117] "RemoveContainer" containerID="6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf" Jul 20 19:59:10.269153 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:10.269138 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf\": container with ID starting with 6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf not found: ID does not exist" containerID="6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf" Jul 20 19:59:10.269210 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.269160 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf"} err="failed to get container status \"6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf\": rpc error: code = NotFound desc = could not find container \"6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf\": container with ID starting with 6a18976dbb6901dcd3ba496aefc799b4291e451ec1dbb985747d45667b215aaf not found: ID does not exist" Jul 20 19:59:10.269210 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.269180 2559 scope.go:117] "RemoveContainer" containerID="68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da" Jul 20 19:59:10.269415 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:10.269399 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da\": container with ID starting with 68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da not found: ID does not exist" containerID="68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da" Jul 20 19:59:10.269451 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.269419 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da"} err="failed to get container status \"68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da\": rpc error: code = NotFound desc = could not find container \"68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da\": container with ID starting with 68e4b2e82628c57d78194110db9b1fcb8ac7fa6a86323afedf3d5116100d74da not found: ID does not exist" Jul 20 19:59:10.269451 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.269432 2559 scope.go:117] "RemoveContainer" containerID="76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf" Jul 20 19:59:10.269652 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:10.269636 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf\": container with ID starting with 76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf not found: ID does not exist" containerID="76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf" Jul 20 19:59:10.269696 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.269658 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf"} err="failed to get container status \"76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf\": rpc error: code = NotFound desc = could not find container \"76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf\": container with ID starting with 76902b2b6f0c87ca5674ab51d3090cd06c792dc39bcbc76f7ea1a09015952ebf not found: ID does not exist" Jul 20 19:59:10.275732 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.275712 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:59:10.276026 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276000 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-thanos" Jul 20 19:59:10.276072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276028 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-thanos" Jul 20 19:59:10.276072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276040 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="config-reloader" Jul 20 19:59:10.276072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276045 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="config-reloader" Jul 20 19:59:10.276072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276051 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="init-config-reloader" Jul 20 19:59:10.276072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276056 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="init-config-reloader" Jul 20 19:59:10.276072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276063 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="prometheus" Jul 20 19:59:10.276072 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276068 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="prometheus" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276075 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-web" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276081 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-web" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276094 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="thanos-sidecar" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276098 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="thanos-sidecar" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276105 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276109 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276157 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276164 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-thanos" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276170 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="kube-rbac-proxy-web" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276176 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="thanos-sidecar" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276182 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="prometheus" Jul 20 19:59:10.276254 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.276186 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" containerName="config-reloader" Jul 20 19:59:10.279778 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.279763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.282323 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282305 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 19:59:10.282397 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 19:59:10.282505 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 19:59:10.282587 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282570 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 19:59:10.282587 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282581 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h8gtc\"" Jul 20 19:59:10.282712 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282608 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 19:59:10.282712 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282620 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 19:59:10.282805 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.282728 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 19:59:10.283186 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.283171 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 19:59:10.283253 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.283179 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 19:59:10.283602 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.283587 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 19:59:10.283746 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.283699 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-10evlatp5khhg\"" Jul 20 19:59:10.283746 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.283718 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 19:59:10.283746 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.283698 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 19:59:10.285813 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.285794 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 19:59:10.289255 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.289238 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 19:59:10.295915 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.295887 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:59:10.332139 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543e1a78-76d0-4baf-b4d0-bd0e6e558483-config-out\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332250 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332250 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332250 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332349 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332349 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332349 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332427 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332427 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-config\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332427 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332512 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332512 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-web-config\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332569 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332569 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543e1a78-76d0-4baf-b4d0-bd0e6e558483-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332569 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332667 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332667 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332667 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332667 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvcp\" (UniqueName: \"kubernetes.io/projected/543e1a78-76d0-4baf-b4d0-bd0e6e558483-kube-api-access-gmvcp\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.332781 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.332670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.361149 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.361126 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf8a89c-237c-46ea-bd56-bbfed5ab2059" path="/var/lib/kubelet/pods/eaf8a89c-237c-46ea-bd56-bbfed5ab2059/volumes" Jul 20 19:59:10.433516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvcp\" (UniqueName: \"kubernetes.io/projected/543e1a78-76d0-4baf-b4d0-bd0e6e558483-kube-api-access-gmvcp\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543e1a78-76d0-4baf-b4d0-bd0e6e558483-config-out\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433642 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433662 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.433700 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433781 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-config\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.433996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-web-config\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434054 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.434052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434529 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.434088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543e1a78-76d0-4baf-b4d0-bd0e6e558483-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434529 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.434113 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434529 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.434477 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434674 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.434563 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.434674 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.434583 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.435563 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.435532 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.437214 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.436046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.437214 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.436556 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.437214 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.436928 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.438150 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.437530 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/543e1a78-76d0-4baf-b4d0-bd0e6e558483-config-out\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.438150 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.437910 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.438150 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.438059 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.438150 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.438085 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-config\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.438390 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.438355 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.438943 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.438888 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/543e1a78-76d0-4baf-b4d0-bd0e6e558483-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.438943 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.438930 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.439121 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.439093 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-web-config\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.439278 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.439261 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.439398 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.439381 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/543e1a78-76d0-4baf-b4d0-bd0e6e558483-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.439810 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.439795 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/543e1a78-76d0-4baf-b4d0-bd0e6e558483-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.443354 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.443338 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvcp\" (UniqueName: \"kubernetes.io/projected/543e1a78-76d0-4baf-b4d0-bd0e6e558483-kube-api-access-gmvcp\") pod \"prometheus-k8s-0\" (UID: \"543e1a78-76d0-4baf-b4d0-bd0e6e558483\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.591661 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.591574 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:10.747338 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:10.747308 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 19:59:10.750531 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:59:10.750501 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543e1a78_76d0_4baf_b4d0_bd0e6e558483.slice/crio-376451caa22f84803431069aabfb2a0fc67e661543ad8aec50e90de395eacf9a WatchSource:0}: Error finding container 376451caa22f84803431069aabfb2a0fc67e661543ad8aec50e90de395eacf9a: Status 404 returned error can't find the container with id 376451caa22f84803431069aabfb2a0fc67e661543ad8aec50e90de395eacf9a Jul 20 19:59:11.222929 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:11.222888 2559 generic.go:356] "Generic (PLEG): container finished" podID="543e1a78-76d0-4baf-b4d0-bd0e6e558483" containerID="103df509cf314a8cba62c20cecadcef519e2739ff13f7b5353e82949910015d7" exitCode=0 Jul 20 19:59:11.223280 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:11.222934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerDied","Data":"103df509cf314a8cba62c20cecadcef519e2739ff13f7b5353e82949910015d7"} Jul 20 19:59:11.223280 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:11.223052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerStarted","Data":"376451caa22f84803431069aabfb2a0fc67e661543ad8aec50e90de395eacf9a"} Jul 20 19:59:12.230165 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:12.230129 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerStarted","Data":"2fb09e43cf1bfbdb9f49c0474e4cc0983197519c7297c29a68943fafd50cba51"} Jul 20 19:59:12.230516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:12.230196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerStarted","Data":"9ea31b54f8f84169cab7069ff57ccff7f8864a88cd6d4cb0ea500248bd67c7fa"} Jul 20 19:59:12.230516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:12.230230 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerStarted","Data":"3b4351b45524f1e0732eeaf3d4da607b056a30663467981bd7c153ecbcd575e6"} Jul 20 19:59:12.230516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:12.230258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerStarted","Data":"83d2d3b56c28319961518e0026bc3d729a8e1e7db48fba3f39e605dc28341c47"} Jul 20 19:59:12.230516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:12.230282 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerStarted","Data":"62a9d54ec4d7854a73a98467cb5dffcca895a759dd71b883137298ed1c2f81c3"} Jul 20 19:59:12.230516 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:12.230317 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"543e1a78-76d0-4baf-b4d0-bd0e6e558483","Type":"ContainerStarted","Data":"2961b77741bfc255b2dd4f33ecdd8f8fe57e73317e11d2aa98f98181e7f2b290"} Jul 20 19:59:12.274316 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:12.274261 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.256767465 podStartE2EDuration="2.274245765s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.4783ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:12.268094576 +0000 UTC m=+160.451942309" watchObservedRunningTime="2026-07-20 19:59:12.274245765 +0000 UTC m=+160.458093496" Jul 20 19:59:13.383263 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.383232 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb695f587-vghsq"] Jul 20 19:59:13.385377 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.385359 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.413878 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.413850 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb695f587-vghsq"] Jul 20 19:59:13.462636 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.462605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-console-config\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.462787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.462647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-trusted-ca-bundle\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.462787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.462713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-serving-cert\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.462787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.462768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-oauth-config\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.462920 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.462797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m458s\" (UniqueName: \"kubernetes.io/projected/59467d8f-dc35-49c4-81a7-c70e0e657055-kube-api-access-m458s\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.462920 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.462862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-service-ca\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.462920 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.462898 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-oauth-serving-cert\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.474074 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.474047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:13.564057 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.563998 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-console-config\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564233 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-trusted-ca-bundle\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564233 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564113 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-serving-cert\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564233 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-oauth-config\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564233 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m458s\" (UniqueName: \"kubernetes.io/projected/59467d8f-dc35-49c4-81a7-c70e0e657055-kube-api-access-m458s\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564233 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-service-ca\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564233 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-oauth-serving-cert\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564886 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-console-config\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.564988 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.564886 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-trusted-ca-bundle\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.565059 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.565043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-oauth-serving-cert\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.565106 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.565075 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-service-ca\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.567089 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.567062 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-oauth-config\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.568138 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.568110 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-serving-cert\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.571524 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.571500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:13.572076 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.572056 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m458s\" (UniqueName: \"kubernetes.io/projected/59467d8f-dc35-49c4-81a7-c70e0e657055-kube-api-access-m458s\") pod \"console-fb695f587-vghsq\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.673914 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.673818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:13.694838 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.694812 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:13.836441 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:13.836420 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb695f587-vghsq"] Jul 20 19:59:13.838984 ip-10-0-132-157 kubenswrapper[2559]: W0720 19:59:13.838960 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59467d8f_dc35_49c4_81a7_c70e0e657055.slice/crio-8a6aa83744c92f525a1b25258338c099bb64c3dfe19ba137fe9b57891cac4967 WatchSource:0}: Error finding container 8a6aa83744c92f525a1b25258338c099bb64c3dfe19ba137fe9b57891cac4967: Status 404 returned error can't find the container with id 8a6aa83744c92f525a1b25258338c099bb64c3dfe19ba137fe9b57891cac4967 Jul 20 19:59:14.151637 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:14.151598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:14.210165 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:14.210134 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:14.239727 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:14.239706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb695f587-vghsq" event={"ID":"59467d8f-dc35-49c4-81a7-c70e0e657055","Type":"ContainerStarted","Data":"cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a"} Jul 20 19:59:14.239846 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:14.239748 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb695f587-vghsq" event={"ID":"59467d8f-dc35-49c4-81a7-c70e0e657055","Type":"ContainerStarted","Data":"8a6aa83744c92f525a1b25258338c099bb64c3dfe19ba137fe9b57891cac4967"} Jul 20 19:59:14.257285 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:14.257249 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb695f587-vghsq" podStartSLOduration=1.257236117 podStartE2EDuration="1.257236117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:14.255879684 +0000 UTC m=+162.439727418" watchObservedRunningTime="2026-07-20 19:59:14.257236117 +0000 UTC m=+162.441083906" Jul 20 19:59:15.592155 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:15.592124 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 19:59:23.695340 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:23.695255 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:23.695340 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:23.695316 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:23.699935 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:23.699911 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:24.283623 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:24.283597 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fb695f587-vghsq" Jul 20 19:59:24.330449 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:24.330419 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76785ff7b5-llkm9"] Jul 20 19:59:24.438503 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:24.438470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:24.539997 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:24.539866 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:24.597332 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:24.597295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 19:59:49.352888 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.352817 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76785ff7b5-llkm9" podUID="ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" containerName="console" containerID="cri-o://021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62" gracePeriod=15 Jul 20 19:59:49.594223 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.594197 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:59:49.661787 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.661762 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-config\") pod \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " Jul 20 19:59:49.661966 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.661802 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-trusted-ca-bundle\") pod \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " Jul 20 19:59:49.661966 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.661852 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-oauth-config\") pod \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " Jul 20 19:59:49.661966 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.661875 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-service-ca\") pod \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " Jul 20 19:59:49.662121 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.661974 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-oauth-serving-cert\") pod \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " Jul 20 19:59:49.662121 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.662061 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp9lr\" (UniqueName: \"kubernetes.io/projected/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-kube-api-access-rp9lr\") pod \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " Jul 20 19:59:49.662121 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.662092 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-serving-cert\") pod \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\" (UID: \"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf\") " Jul 20 19:59:49.662295 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.662270 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-config" (OuterVolumeSpecName: "console-config") pod "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" (UID: "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:49.662295 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.662320 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" (UID: "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:49.662295 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.662332 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" (UID: "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:49.662295 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.662338 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" (UID: "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:59:49.662295 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.662376 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:49.664213 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.664186 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" (UID: "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:49.664304 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.664246 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" (UID: "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 19:59:49.664346 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.664318 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-kube-api-access-rp9lr" (OuterVolumeSpecName: "kube-api-access-rp9lr") pod "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" (UID: "ea19f3ed-fd02-4787-8d7b-fcd730caa0cf"). InnerVolumeSpecName "kube-api-access-rp9lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:59:49.763320 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.763294 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-trusted-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:49.763320 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.763316 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-oauth-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:49.763465 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.763325 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:49.763465 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.763334 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-oauth-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:49.763465 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.763343 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp9lr\" (UniqueName: \"kubernetes.io/projected/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-kube-api-access-rp9lr\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:49.763465 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:49.763350 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf-console-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 19:59:50.376525 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.376498 2559 generic.go:356] "Generic (PLEG): container finished" podID="ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" containerID="021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62" exitCode=0 Jul 20 19:59:50.376864 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.376540 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76785ff7b5-llkm9" Jul 20 19:59:50.376864 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.376581 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76785ff7b5-llkm9" event={"ID":"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf","Type":"ContainerDied","Data":"021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62"} Jul 20 19:59:50.376864 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.376629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76785ff7b5-llkm9" event={"ID":"ea19f3ed-fd02-4787-8d7b-fcd730caa0cf","Type":"ContainerDied","Data":"da9307d04ac6bb600b00ba94b5a74dead6be3b69a50ec90d05c8e85c1db9c470"} Jul 20 19:59:50.376864 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.376657 2559 scope.go:117] "RemoveContainer" containerID="021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62" Jul 20 19:59:50.384731 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.384714 2559 scope.go:117] "RemoveContainer" containerID="021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62" Jul 20 19:59:50.385000 ip-10-0-132-157 kubenswrapper[2559]: E0720 19:59:50.384980 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62\": container with ID starting with 021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62 not found: ID does not exist" containerID="021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62" Jul 20 19:59:50.385074 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.385026 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62"} err="failed to get container status \"021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62\": rpc error: code = NotFound desc = could not find container \"021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62\": container with ID starting with 021bd6f3d47b0eb85ac9b14a64adc189446eb3d9bf1d3076d104975ba6d88e62 not found: ID does not exist" Jul 20 19:59:50.396334 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.396301 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76785ff7b5-llkm9"] Jul 20 19:59:50.402941 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:50.402919 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76785ff7b5-llkm9"] Jul 20 19:59:52.361105 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:52.361074 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" path="/var/lib/kubelet/pods/ea19f3ed-fd02-4787-8d7b-fcd730caa0cf/volumes" Jul 20 19:59:54.240975 ip-10-0-132-157 kubenswrapper[2559]: I0720 19:59:54.240940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:03.304691 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:03.304657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:03.365805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:03.365784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:10.592739 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:10.592710 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 20:00:10.607293 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:10.607268 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 20:00:11.472945 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:11.472916 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 20:00:18.520426 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:18.520399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:18.596586 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:18.596559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:21.085056 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.085027 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78977686cd-kql7g"] Jul 20 20:00:21.085401 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.085341 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" containerName="console" Jul 20 20:00:21.085401 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.085352 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" containerName="console" Jul 20 20:00:21.085470 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.085406 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea19f3ed-fd02-4787-8d7b-fcd730caa0cf" containerName="console" Jul 20 20:00:21.088433 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.088416 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.098236 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.098215 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78977686cd-kql7g"] Jul 20 20:00:21.153006 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.152981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:21.208866 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.208846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-service-ca\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.208958 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.208875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-oauth-config\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.208958 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.208910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-trusted-ca-bundle\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.209047 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.208968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-serving-cert\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.209083 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.209054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-console-config\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.209115 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.209089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lnr7\" (UniqueName: \"kubernetes.io/projected/6fd0fc3f-687f-46c9-b113-170e97344802-kube-api-access-9lnr7\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.209115 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.209109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-oauth-serving-cert\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310127 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-console-config\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310207 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lnr7\" (UniqueName: \"kubernetes.io/projected/6fd0fc3f-687f-46c9-b113-170e97344802-kube-api-access-9lnr7\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310207 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-oauth-serving-cert\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310207 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-service-ca\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310339 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-oauth-config\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310407 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-trusted-ca-bundle\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310466 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-serving-cert\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310852 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-oauth-serving-cert\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310960 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-console-config\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.310960 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.310916 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-service-ca\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.311270 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.311112 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-trusted-ca-bundle\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.312847 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.312820 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-serving-cert\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.312952 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.312930 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-oauth-config\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.318287 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.318268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lnr7\" (UniqueName: \"kubernetes.io/projected/6fd0fc3f-687f-46c9-b113-170e97344802-kube-api-access-9lnr7\") pod \"console-78977686cd-kql7g\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.373849 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.373803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:21.396595 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.396574 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:21.520128 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.520105 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78977686cd-kql7g"] Jul 20 20:00:21.522152 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.522126 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:21.522801 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:00:21.522779 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd0fc3f_687f_46c9_b113_170e97344802.slice/crio-94d4da1d357436f1c8d91a81baeae798f86533599b4051ac1f2ec457a6676676 WatchSource:0}: Error finding container 94d4da1d357436f1c8d91a81baeae798f86533599b4051ac1f2ec457a6676676: Status 404 returned error can't find the container with id 94d4da1d357436f1c8d91a81baeae798f86533599b4051ac1f2ec457a6676676 Jul 20 20:00:21.884570 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.884540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:21.948160 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:21.948136 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:22.501344 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:22.501314 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78977686cd-kql7g" event={"ID":"6fd0fc3f-687f-46c9-b113-170e97344802","Type":"ContainerStarted","Data":"f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd"} Jul 20 20:00:22.501762 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:22.501358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78977686cd-kql7g" event={"ID":"6fd0fc3f-687f-46c9-b113-170e97344802","Type":"ContainerStarted","Data":"94d4da1d357436f1c8d91a81baeae798f86533599b4051ac1f2ec457a6676676"} Jul 20 20:00:22.520204 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:22.520151 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78977686cd-kql7g" podStartSLOduration=1.520132894 podStartE2EDuration="1.520132894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:00:22.519570183 +0000 UTC m=+230.703417918" watchObservedRunningTime="2026-07-20 20:00:22.520132894 +0000 UTC m=+230.703980626" Jul 20 20:00:30.520648 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:30.520616 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:30.587673 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:30.587644 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:31.397664 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.397638 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:31.397810 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.397680 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:31.402721 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.402700 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:31.538586 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.538565 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:00:31.586098 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.586075 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb695f587-vghsq"] Jul 20 20:00:31.694831 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.694761 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:31.752164 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.752141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:31.804706 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:31.804682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:33.919725 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:33.919694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:34.013484 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:34.013461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:34.113688 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:34.113662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:00:56.605472 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.605385 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fb695f587-vghsq" podUID="59467d8f-dc35-49c4-81a7-c70e0e657055" containerName="console" containerID="cri-o://cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a" gracePeriod=15 Jul 20 20:00:56.839105 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.839085 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb695f587-vghsq" Jul 20 20:00:56.871368 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871312 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m458s\" (UniqueName: \"kubernetes.io/projected/59467d8f-dc35-49c4-81a7-c70e0e657055-kube-api-access-m458s\") pod \"59467d8f-dc35-49c4-81a7-c70e0e657055\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " Jul 20 20:00:56.871368 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871350 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-service-ca\") pod \"59467d8f-dc35-49c4-81a7-c70e0e657055\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " Jul 20 20:00:56.871537 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871387 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-trusted-ca-bundle\") pod \"59467d8f-dc35-49c4-81a7-c70e0e657055\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " Jul 20 20:00:56.871537 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871402 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-oauth-config\") pod \"59467d8f-dc35-49c4-81a7-c70e0e657055\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " Jul 20 20:00:56.871537 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871444 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-console-config\") pod \"59467d8f-dc35-49c4-81a7-c70e0e657055\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " Jul 20 20:00:56.871537 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871478 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-serving-cert\") pod \"59467d8f-dc35-49c4-81a7-c70e0e657055\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " Jul 20 20:00:56.871537 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871496 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-oauth-serving-cert\") pod \"59467d8f-dc35-49c4-81a7-c70e0e657055\" (UID: \"59467d8f-dc35-49c4-81a7-c70e0e657055\") " Jul 20 20:00:56.871795 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871771 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-service-ca" (OuterVolumeSpecName: "service-ca") pod "59467d8f-dc35-49c4-81a7-c70e0e657055" (UID: "59467d8f-dc35-49c4-81a7-c70e0e657055"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:00:56.871852 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871794 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59467d8f-dc35-49c4-81a7-c70e0e657055" (UID: "59467d8f-dc35-49c4-81a7-c70e0e657055"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:00:56.872001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.871966 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59467d8f-dc35-49c4-81a7-c70e0e657055" (UID: "59467d8f-dc35-49c4-81a7-c70e0e657055"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:00:56.872142 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.872103 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-console-config" (OuterVolumeSpecName: "console-config") pod "59467d8f-dc35-49c4-81a7-c70e0e657055" (UID: "59467d8f-dc35-49c4-81a7-c70e0e657055"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:00:56.873475 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.873445 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59467d8f-dc35-49c4-81a7-c70e0e657055" (UID: "59467d8f-dc35-49c4-81a7-c70e0e657055"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:00:56.873608 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.873582 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59467d8f-dc35-49c4-81a7-c70e0e657055" (UID: "59467d8f-dc35-49c4-81a7-c70e0e657055"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:00:56.873898 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.873877 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59467d8f-dc35-49c4-81a7-c70e0e657055-kube-api-access-m458s" (OuterVolumeSpecName: "kube-api-access-m458s") pod "59467d8f-dc35-49c4-81a7-c70e0e657055" (UID: "59467d8f-dc35-49c4-81a7-c70e0e657055"). InnerVolumeSpecName "kube-api-access-m458s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:00:56.972564 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.972541 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m458s\" (UniqueName: \"kubernetes.io/projected/59467d8f-dc35-49c4-81a7-c70e0e657055-kube-api-access-m458s\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:00:56.972564 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.972560 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:00:56.972679 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.972568 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-trusted-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:00:56.972679 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.972576 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-oauth-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:00:56.972679 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.972584 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-console-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:00:56.972679 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.972592 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59467d8f-dc35-49c4-81a7-c70e0e657055-console-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:00:56.972679 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:56.972599 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59467d8f-dc35-49c4-81a7-c70e0e657055-oauth-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:00:57.633128 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.633099 2559 generic.go:356] "Generic (PLEG): container finished" podID="59467d8f-dc35-49c4-81a7-c70e0e657055" containerID="cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a" exitCode=0 Jul 20 20:00:57.633533 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.633138 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb695f587-vghsq" Jul 20 20:00:57.633533 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.633175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb695f587-vghsq" event={"ID":"59467d8f-dc35-49c4-81a7-c70e0e657055","Type":"ContainerDied","Data":"cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a"} Jul 20 20:00:57.633533 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.633211 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb695f587-vghsq" event={"ID":"59467d8f-dc35-49c4-81a7-c70e0e657055","Type":"ContainerDied","Data":"8a6aa83744c92f525a1b25258338c099bb64c3dfe19ba137fe9b57891cac4967"} Jul 20 20:00:57.633533 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.633231 2559 scope.go:117] "RemoveContainer" containerID="cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a" Jul 20 20:00:57.646582 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.646560 2559 scope.go:117] "RemoveContainer" containerID="cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a" Jul 20 20:00:57.646875 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:00:57.646854 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a\": container with ID starting with cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a not found: ID does not exist" containerID="cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a" Jul 20 20:00:57.646943 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.646882 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a"} err="failed to get container status \"cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a\": rpc error: code = NotFound desc = could not find container \"cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a\": container with ID starting with cd8aaf2fac4dbbb544cd48e63c2f1732b0656f8c0dbbcbbe1737e9d731104a4a not found: ID does not exist" Jul 20 20:00:57.656665 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.656645 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb695f587-vghsq"] Jul 20 20:00:57.660467 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:57.660449 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb695f587-vghsq"] Jul 20 20:00:58.360648 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:00:58.360622 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59467d8f-dc35-49c4-81a7-c70e0e657055" path="/var/lib/kubelet/pods/59467d8f-dc35-49c4-81a7-c70e0e657055/volumes" Jul 20 20:01:32.209108 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:01:32.209083 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 20:01:32.807934 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:01:32.807904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:34.561440 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:01:34.561412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:55.305597 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:01:55.305552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:56.705556 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:01:56.705510 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:58.931487 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:01:58.931456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:01:59.079490 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:01:59.079453 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:00.650824 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:00.650787 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:00.756190 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:00.756165 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:01.374555 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:01.374524 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:01.460321 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:01.460297 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:03.433935 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:03.433904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:03.598425 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:03.598399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:04.148966 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.148938 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j"] Jul 20 20:02:04.149302 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.149290 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59467d8f-dc35-49c4-81a7-c70e0e657055" containerName="console" Jul 20 20:02:04.149346 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.149306 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="59467d8f-dc35-49c4-81a7-c70e0e657055" containerName="console" Jul 20 20:02:04.149377 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.149363 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="59467d8f-dc35-49c4-81a7-c70e0e657055" containerName="console" Jul 20 20:02:04.152256 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.152240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.158368 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.158217 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-txqfg\"" Jul 20 20:02:04.159054 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.159038 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 20:02:04.159054 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.159047 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 20:02:04.170559 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.170532 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j"] Jul 20 20:02:04.253864 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.253842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wsq4\" (UniqueName: \"kubernetes.io/projected/7233dd15-a232-4094-9235-d1f3e46117d2-kube-api-access-7wsq4\") pod \"cert-manager-cainjector-559cdd8c87-cwc9j\" (UID: \"7233dd15-a232-4094-9235-d1f3e46117d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.253992 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.253885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7233dd15-a232-4094-9235-d1f3e46117d2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cwc9j\" (UID: \"7233dd15-a232-4094-9235-d1f3e46117d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.354941 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.354917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wsq4\" (UniqueName: \"kubernetes.io/projected/7233dd15-a232-4094-9235-d1f3e46117d2-kube-api-access-7wsq4\") pod \"cert-manager-cainjector-559cdd8c87-cwc9j\" (UID: \"7233dd15-a232-4094-9235-d1f3e46117d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.355072 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.354960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7233dd15-a232-4094-9235-d1f3e46117d2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cwc9j\" (UID: \"7233dd15-a232-4094-9235-d1f3e46117d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.366648 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.366627 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7233dd15-a232-4094-9235-d1f3e46117d2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cwc9j\" (UID: \"7233dd15-a232-4094-9235-d1f3e46117d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.366946 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.366924 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wsq4\" (UniqueName: \"kubernetes.io/projected/7233dd15-a232-4094-9235-d1f3e46117d2-kube-api-access-7wsq4\") pod \"cert-manager-cainjector-559cdd8c87-cwc9j\" (UID: \"7233dd15-a232-4094-9235-d1f3e46117d2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.469346 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.469279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" Jul 20 20:02:04.597981 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.597958 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j"] Jul 20 20:02:04.599898 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:02:04.599870 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7233dd15_a232_4094_9235_d1f3e46117d2.slice/crio-f6fa01a5b8ff7ed93e603be6cd3848eea264e98be3c73560a3cb4b5a6f4364c3 WatchSource:0}: Error finding container f6fa01a5b8ff7ed93e603be6cd3848eea264e98be3c73560a3cb4b5a6f4364c3: Status 404 returned error can't find the container with id f6fa01a5b8ff7ed93e603be6cd3848eea264e98be3c73560a3cb4b5a6f4364c3 Jul 20 20:02:04.601884 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.601869 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 20:02:04.880720 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:04.880692 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" event={"ID":"7233dd15-a232-4094-9235-d1f3e46117d2","Type":"ContainerStarted","Data":"f6fa01a5b8ff7ed93e603be6cd3848eea264e98be3c73560a3cb4b5a6f4364c3"} Jul 20 20:02:05.926173 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:05.926139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:05.997060 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:05.997006 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:08.662818 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:08.662773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:08.729375 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:08.729345 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:08.904379 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:08.904342 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" event={"ID":"7233dd15-a232-4094-9235-d1f3e46117d2","Type":"ContainerStarted","Data":"a882087a60d1fd3460291e4c3678858b037028f488c47076dcc103101eaa491e"} Jul 20 20:02:08.936729 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:08.936634 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cwc9j" podStartSLOduration=1.655956027 podStartE2EDuration="4.936617932s" totalImagesPullingTime="3.280661905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:08.935508203 +0000 UTC m=+337.119355934" watchObservedRunningTime="2026-07-20 20:02:08.936617932 +0000 UTC m=+337.120465666" Jul 20 20:02:11.606052 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:11.605986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:12.323827 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:12.323788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:12.429054 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:12.429001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:14.583759 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.583718 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk"] Jul 20 20:02:14.586999 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.586982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:14.590300 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.590273 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 20:02:14.590430 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.590320 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lch2v\"" Jul 20 20:02:14.590430 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.590276 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 20:02:14.602877 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.602859 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk"] Jul 20 20:02:14.637723 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.637697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2c65\" (UniqueName: \"kubernetes.io/projected/2f20a51f-7900-4170-a96e-0baae26fdb2f-kube-api-access-z2c65\") pod \"openshift-lws-operator-fd8ccff4c-jdzhk\" (UID: \"2f20a51f-7900-4170-a96e-0baae26fdb2f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:14.637842 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.637729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f20a51f-7900-4170-a96e-0baae26fdb2f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jdzhk\" (UID: \"2f20a51f-7900-4170-a96e-0baae26fdb2f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:14.738484 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.738457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2c65\" (UniqueName: \"kubernetes.io/projected/2f20a51f-7900-4170-a96e-0baae26fdb2f-kube-api-access-z2c65\") pod \"openshift-lws-operator-fd8ccff4c-jdzhk\" (UID: \"2f20a51f-7900-4170-a96e-0baae26fdb2f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:14.738484 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.738489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f20a51f-7900-4170-a96e-0baae26fdb2f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jdzhk\" (UID: \"2f20a51f-7900-4170-a96e-0baae26fdb2f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:14.738825 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.738808 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f20a51f-7900-4170-a96e-0baae26fdb2f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jdzhk\" (UID: \"2f20a51f-7900-4170-a96e-0baae26fdb2f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:14.747091 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.747068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2c65\" (UniqueName: \"kubernetes.io/projected/2f20a51f-7900-4170-a96e-0baae26fdb2f-kube-api-access-z2c65\") pod \"openshift-lws-operator-fd8ccff4c-jdzhk\" (UID: \"2f20a51f-7900-4170-a96e-0baae26fdb2f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:14.896794 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:14.896757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" Jul 20 20:02:15.021623 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:15.021600 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk"] Jul 20 20:02:15.024114 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:02:15.024088 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f20a51f_7900_4170_a96e_0baae26fdb2f.slice/crio-d0482e13bbae59a5e3745b08cbaab7a747d6d8fc6ccb53fdba68ac7c469b5ea2 WatchSource:0}: Error finding container d0482e13bbae59a5e3745b08cbaab7a747d6d8fc6ccb53fdba68ac7c469b5ea2: Status 404 returned error can't find the container with id d0482e13bbae59a5e3745b08cbaab7a747d6d8fc6ccb53fdba68ac7c469b5ea2 Jul 20 20:02:15.933529 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:15.933489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" event={"ID":"2f20a51f-7900-4170-a96e-0baae26fdb2f","Type":"ContainerStarted","Data":"d0482e13bbae59a5e3745b08cbaab7a747d6d8fc6ccb53fdba68ac7c469b5ea2"} Jul 20 20:02:17.943862 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:17.943778 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" event={"ID":"2f20a51f-7900-4170-a96e-0baae26fdb2f","Type":"ContainerStarted","Data":"e52decf4937d578158913b4d8542ed50aaf30e0a263587b298e6087af771f3ec"} Jul 20 20:02:17.960650 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:17.960603 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jdzhk" podStartSLOduration=1.333306667 podStartE2EDuration="3.960582638s" totalImagesPullingTime="2.627275971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:17.960432657 +0000 UTC m=+346.144280403" watchObservedRunningTime="2026-07-20 20:02:17.960582638 +0000 UTC m=+346.144430369" Jul 20 20:02:18.809749 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:18.809713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:18.909878 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:18.909825 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:20.784885 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:20.784829 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:32.847823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:32.847725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:32.964230 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:32.964193 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:33.428989 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:33.428937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:33.894467 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:33.894437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:33.995276 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:33.995239 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:34.108706 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.108682 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x"] Jul 20 20:02:34.112118 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.112102 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.119596 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.119580 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w6tt6\"" Jul 20 20:02:34.119751 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.119730 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 20:02:34.120193 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.120181 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 20:02:34.120255 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.120238 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 20:02:34.128146 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.128128 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 20:02:34.167448 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.167397 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x"] Jul 20 20:02:34.188635 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.188611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcjwm\" (UniqueName: \"kubernetes.io/projected/b110ce57-5731-4bcd-8628-9a02d1ba84d5-kube-api-access-vcjwm\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.188727 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.188642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b110ce57-5731-4bcd-8628-9a02d1ba84d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.188727 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.188685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b110ce57-5731-4bcd-8628-9a02d1ba84d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.188813 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.188732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b110ce57-5731-4bcd-8628-9a02d1ba84d5-tmp\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.188813 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.188776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b110ce57-5731-4bcd-8628-9a02d1ba84d5-manifests\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.289771 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.289749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b110ce57-5731-4bcd-8628-9a02d1ba84d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.289879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.289805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b110ce57-5731-4bcd-8628-9a02d1ba84d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.289879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.289826 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b110ce57-5731-4bcd-8628-9a02d1ba84d5-tmp\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.289879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.289844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b110ce57-5731-4bcd-8628-9a02d1ba84d5-manifests\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.289975 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.289886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcjwm\" (UniqueName: \"kubernetes.io/projected/b110ce57-5731-4bcd-8628-9a02d1ba84d5-kube-api-access-vcjwm\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.290294 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.290267 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b110ce57-5731-4bcd-8628-9a02d1ba84d5-manifests\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.292220 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.292198 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b110ce57-5731-4bcd-8628-9a02d1ba84d5-tmp\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.292397 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.292381 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b110ce57-5731-4bcd-8628-9a02d1ba84d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.292437 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.292376 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b110ce57-5731-4bcd-8628-9a02d1ba84d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.300520 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.300499 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcjwm\" (UniqueName: \"kubernetes.io/projected/b110ce57-5731-4bcd-8628-9a02d1ba84d5-kube-api-access-vcjwm\") pod \"opendatahub-operator-controller-manager-77cb6d7555-t7z7x\" (UID: \"b110ce57-5731-4bcd-8628-9a02d1ba84d5\") " pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.355402 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.355381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:34.422497 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.422445 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:34.468865 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.468840 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:34.555092 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.555070 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x"] Jul 20 20:02:34.556723 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:02:34.556696 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb110ce57_5731_4bcd_8628_9a02d1ba84d5.slice/crio-f07581b0ba8806ee4c915b36cdc254cfa09d1f28121fc8545c7a13eded0a53e0 WatchSource:0}: Error finding container f07581b0ba8806ee4c915b36cdc254cfa09d1f28121fc8545c7a13eded0a53e0: Status 404 returned error can't find the container with id f07581b0ba8806ee4c915b36cdc254cfa09d1f28121fc8545c7a13eded0a53e0 Jul 20 20:02:34.560230 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.560200 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:34.644118 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.644091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:34.808763 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.808701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:34.908117 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:34.908093 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:35.010317 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:35.010288 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" event={"ID":"b110ce57-5731-4bcd-8628-9a02d1ba84d5","Type":"ContainerStarted","Data":"f07581b0ba8806ee4c915b36cdc254cfa09d1f28121fc8545c7a13eded0a53e0"} Jul 20 20:02:38.025966 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:38.025926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" event={"ID":"b110ce57-5731-4bcd-8628-9a02d1ba84d5","Type":"ContainerStarted","Data":"7d271bf99b00443e3192211315c482c6abdaab9a076239f6387f80054ae230a4"} Jul 20 20:02:39.031505 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:39.031478 2559 generic.go:356] "Generic (PLEG): container finished" podID="b110ce57-5731-4bcd-8628-9a02d1ba84d5" containerID="7d271bf99b00443e3192211315c482c6abdaab9a076239f6387f80054ae230a4" exitCode=0 Jul 20 20:02:39.031836 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:39.031531 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" event={"ID":"b110ce57-5731-4bcd-8628-9a02d1ba84d5","Type":"ContainerDied","Data":"7d271bf99b00443e3192211315c482c6abdaab9a076239f6387f80054ae230a4"} Jul 20 20:02:40.037954 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:40.037918 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" event={"ID":"b110ce57-5731-4bcd-8628-9a02d1ba84d5","Type":"ContainerStarted","Data":"625e02c011d55bd0b33ea243db9df3ca66e17dcbc2387bfac89a15ee003c6aa0"} Jul 20 20:02:40.038446 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:40.038080 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:40.062534 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:40.062490 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" podStartSLOduration=1.785196964 podStartE2EDuration="6.062474545s" totalImagesPullingTime="3.369256376s" totalInitContainerRuntime="908.021205ms" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:40.060929834 +0000 UTC m=+368.244777568" watchObservedRunningTime="2026-07-20 20:02:40.062474545 +0000 UTC m=+368.246322276" Jul 20 20:02:45.253141 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:45.253108 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:45.320430 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:45.320406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:45.694646 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:45.694618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:45.758089 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:45.758062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:51.043636 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:51.043603 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77cb6d7555-t7z7x" Jul 20 20:02:53.373321 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:53.373288 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:53.557508 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:53.557474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:54.050442 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:54.050406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:54.284505 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:54.284474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:54.385268 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:54.385245 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:55.399097 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.399066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:55.487288 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.487254 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g"] Jul 20 20:02:55.491709 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.491694 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.502668 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.502649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 20:02:55.502783 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.502649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 20:02:55.503358 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.503342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 20:02:55.503434 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.503342 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7vkk8\"" Jul 20 20:02:55.516765 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.516721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:55.521807 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.521781 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g"] Jul 20 20:02:55.569740 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.569710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9936e923-1633-40af-9c33-5b5dbdc88c0a-cert\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.569929 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.569749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9936e923-1633-40af-9c33-5b5dbdc88c0a-metrics-cert\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.569929 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.569767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7md\" (UniqueName: \"kubernetes.io/projected/9936e923-1633-40af-9c33-5b5dbdc88c0a-kube-api-access-vl7md\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.569929 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.569842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9936e923-1633-40af-9c33-5b5dbdc88c0a-manager-config\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.670404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.670310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9936e923-1633-40af-9c33-5b5dbdc88c0a-cert\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.670404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.670367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9936e923-1633-40af-9c33-5b5dbdc88c0a-metrics-cert\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.670404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.670385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7md\" (UniqueName: \"kubernetes.io/projected/9936e923-1633-40af-9c33-5b5dbdc88c0a-kube-api-access-vl7md\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.670639 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.670426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9936e923-1633-40af-9c33-5b5dbdc88c0a-manager-config\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.671186 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.671136 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9936e923-1633-40af-9c33-5b5dbdc88c0a-manager-config\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.672894 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.672873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9936e923-1633-40af-9c33-5b5dbdc88c0a-cert\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.672985 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.672917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9936e923-1633-40af-9c33-5b5dbdc88c0a-metrics-cert\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.691384 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.691359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7md\" (UniqueName: \"kubernetes.io/projected/9936e923-1633-40af-9c33-5b5dbdc88c0a-kube-api-access-vl7md\") pod \"lws-controller-manager-7f6758cc7d-cxm7g\" (UID: \"9936e923-1633-40af-9c33-5b5dbdc88c0a\") " pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.800162 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.800128 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:55.845427 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.845386 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:55.961391 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.959403 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g"] Jul 20 20:02:55.961391 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:55.960684 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:56.106951 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:56.106917 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" event={"ID":"9936e923-1633-40af-9c33-5b5dbdc88c0a","Type":"ContainerStarted","Data":"f4f1509bd8aa05f6a34f9bad99abe8d56cca20e90e97054754cd67a5a025aed7"} Jul 20 20:02:57.637047 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:57.636989 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:02:58.117890 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:58.117859 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" event={"ID":"9936e923-1633-40af-9c33-5b5dbdc88c0a","Type":"ContainerStarted","Data":"aa3443ef893bb78e72e1da206a7bfc80498bac78a6399e29940c9817bd2f2169"} Jul 20 20:02:58.118104 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:58.118008 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:02:58.136318 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:58.136265 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" podStartSLOduration=1.5606987289999998 podStartE2EDuration="3.136245631s" totalImagesPullingTime="1.575546902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:58.135320376 +0000 UTC m=+386.319168108" watchObservedRunningTime="2026-07-20 20:02:58.136245631 +0000 UTC m=+386.320093364" Jul 20 20:02:59.988454 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:02:59.988408 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:00.086965 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.086936 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:00.349166 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.349096 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg"] Jul 20 20:03:00.352854 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.352836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.356413 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.356389 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 20:03:00.358139 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.358117 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 20:03:00.362585 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.362569 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vnrnr\"" Jul 20 20:03:00.362892 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.362877 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 20:03:00.377840 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.377819 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg"] Jul 20 20:03:00.398592 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.398572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:00.511947 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.511924 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8"] Jul 20 20:03:00.515238 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.515217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.516858 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.516838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.516954 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.516893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.517057 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.516994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.517104 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.517073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e663b6c-bb4d-4480-a94a-51b739b99789-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.517142 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.517112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.517188 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.517174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.517222 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.517205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.517251 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.517221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zxp6\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-kube-api-access-7zxp6\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.517286 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.517267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.547952 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.547931 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8"] Jul 20 20:03:00.594868 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.594842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:00.618478 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.618478 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.618478 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.618681 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.618681 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.618681 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.618681 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618568 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmv5\" (UniqueName: \"kubernetes.io/projected/059e6526-1b2e-4db2-9f3c-b249ed485471-kube-api-access-8qmv5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.618681 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.618903 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.618903 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e663b6c-bb4d-4480-a94a-51b739b99789-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.618903 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/059e6526-1b2e-4db2-9f3c-b249ed485471-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.618903 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.618903 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.618903 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.619353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.619353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618958 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.619353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.618992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zxp6\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-kube-api-access-7zxp6\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.619353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.619055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.619353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.619090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.619353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.619144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.619648 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.619357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.619648 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.619457 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.619748 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.619687 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e663b6c-bb4d-4480-a94a-51b739b99789-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.621452 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.621428 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.621557 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.621540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.644450 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.644423 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.644606 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.644588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zxp6\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-kube-api-access-7zxp6\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.663542 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.663524 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.720923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.720965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721178 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmv5\" (UniqueName: \"kubernetes.io/projected/059e6526-1b2e-4db2-9f3c-b249ed485471-kube-api-access-8qmv5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/059e6526-1b2e-4db2-9f3c-b249ed485471-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.721937 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/059e6526-1b2e-4db2-9f3c-b249ed485471-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.722196 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.722398 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.723168 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.724034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.723455 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.727105 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.726525 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.741111 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.739712 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.741111 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.740247 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/059e6526-1b2e-4db2-9f3c-b249ed485471-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.751527 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.751503 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmv5\" (UniqueName: \"kubernetes.io/projected/059e6526-1b2e-4db2-9f3c-b249ed485471-kube-api-access-8qmv5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jrpd8\" (UID: \"059e6526-1b2e-4db2-9f3c-b249ed485471\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.824528 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.824501 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:00.844956 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.844933 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg"] Jul 20 20:03:00.847080 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:03:00.847005 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e663b6c_bb4d_4480_a94a_51b739b99789.slice/crio-07463c76bf77b660868b0de56cd1f646cafcd508737ddb996274239d58c60fa9 WatchSource:0}: Error finding container 07463c76bf77b660868b0de56cd1f646cafcd508737ddb996274239d58c60fa9: Status 404 returned error can't find the container with id 07463c76bf77b660868b0de56cd1f646cafcd508737ddb996274239d58c60fa9 Jul 20 20:03:00.980204 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:00.980179 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8"] Jul 20 20:03:00.981522 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:03:00.981496 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059e6526_1b2e_4db2_9f3c_b249ed485471.slice/crio-3cc262681c891b998392725972dfee1f746138e56a60e5a8f95e90a19f99b54a WatchSource:0}: Error finding container 3cc262681c891b998392725972dfee1f746138e56a60e5a8f95e90a19f99b54a: Status 404 returned error can't find the container with id 3cc262681c891b998392725972dfee1f746138e56a60e5a8f95e90a19f99b54a Jul 20 20:03:01.132893 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:01.132755 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" event={"ID":"059e6526-1b2e-4db2-9f3c-b249ed485471","Type":"ContainerStarted","Data":"3cc262681c891b998392725972dfee1f746138e56a60e5a8f95e90a19f99b54a"} Jul 20 20:03:01.139350 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:01.139316 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" event={"ID":"9e663b6c-bb4d-4480-a94a-51b739b99789","Type":"ContainerStarted","Data":"07463c76bf77b660868b0de56cd1f646cafcd508737ddb996274239d58c60fa9"} Jul 20 20:03:01.246352 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:01.246285 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:03.761675 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:03.761634 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:03.761992 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:03.761716 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:03.761992 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:03.761744 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:04.157054 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:04.156986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" event={"ID":"9e663b6c-bb4d-4480-a94a-51b739b99789","Type":"ContainerStarted","Data":"d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7"} Jul 20 20:03:04.274423 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:04.274376 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podStartSLOduration=1.361739115 podStartE2EDuration="4.274348581s" totalImagesPullingTime="2.912609466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:04.270127168 +0000 UTC m=+392.453974898" watchObservedRunningTime="2026-07-20 20:03:04.274348581 +0000 UTC m=+392.458196291" Jul 20 20:03:04.664568 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:04.664535 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:04.665628 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:04.665606 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:04.665715 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:04.665651 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:05.260140 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.260112 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx"] Jul 20 20:03:05.263256 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.263239 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.272733 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.272717 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9gdqj\"" Jul 20 20:03:05.274403 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.274388 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 20:03:05.276412 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.276397 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 20:03:05.276503 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.276440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 20:03:05.366776 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.366755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.366864 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.366781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.366864 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.366803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pk4s\" (UniqueName: \"kubernetes.io/projected/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-kube-api-access-8pk4s\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.366864 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.366851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.366979 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.366876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.366979 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.366893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.366979 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.366916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.375066 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.375047 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx"] Jul 20 20:03:05.468162 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.468141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.468277 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.468169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pk4s\" (UniqueName: \"kubernetes.io/projected/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-kube-api-access-8pk4s\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.468277 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.468197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.468277 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.468214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.468277 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.468238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.468469 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.468365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.468558 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.468538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.469237 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.469209 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.470602 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.470584 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.470805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.470787 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.471244 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.471226 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.471296 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.471235 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.492244 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.492221 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pk4s\" (UniqueName: \"kubernetes.io/projected/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-kube-api-access-8pk4s\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.494861 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.494840 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qtdcx\" (UID: \"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.572102 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.572026 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:05.665154 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.664880 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:05.665154 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.664950 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:05.797837 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:05.797805 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx"] Jul 20 20:03:05.814533 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:03:05.814507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304d84ae_3d6e_44c1_ad8f_06d6f5c8d67e.slice/crio-560e7dfbebe5e947a2be4cc2f280edd1178c28a815d4fbc109014785c73bd5e0 WatchSource:0}: Error finding container 560e7dfbebe5e947a2be4cc2f280edd1178c28a815d4fbc109014785c73bd5e0: Status 404 returned error can't find the container with id 560e7dfbebe5e947a2be4cc2f280edd1178c28a815d4fbc109014785c73bd5e0 Jul 20 20:03:06.166747 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:06.166708 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" event={"ID":"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e","Type":"ContainerStarted","Data":"560e7dfbebe5e947a2be4cc2f280edd1178c28a815d4fbc109014785c73bd5e0"} Jul 20 20:03:06.664271 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:06.664234 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:06.664697 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:06.664296 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:06.665763 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:06.665734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:06.917237 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:06.917149 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:07.012304 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:07.012272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:07.664297 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:07.664260 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:07.664705 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:07.664338 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:07.987815 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:07.987657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:08.078109 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:08.078053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:08.372297 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:08.372263 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:08.372376 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:08.372328 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:08.387914 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:08.387888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:08.664788 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:08.664750 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:08.665211 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:08.664826 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:09.125443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.125372 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f6758cc7d-cxm7g" Jul 20 20:03:09.185438 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.185402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" event={"ID":"304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e","Type":"ContainerStarted","Data":"ea44bff8a6dc845f884bf7440d0e7c8373d14f57041767439e426f26993d01f8"} Jul 20 20:03:09.185869 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.185542 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:09.187003 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.186977 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-qtdcx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 20:03:09.187162 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.187052 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" podUID="304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 20:03:09.213454 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.213404 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" podStartSLOduration=1.657811639 podStartE2EDuration="4.21338639s" totalImagesPullingTime="2.555574751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:09.211885598 +0000 UTC m=+397.395733512" watchObservedRunningTime="2026-07-20 20:03:09.21338639 +0000 UTC m=+397.397234124" Jul 20 20:03:09.664059 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.664000 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:09.664234 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:09.664092 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:10.190397 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:10.190370 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qtdcx" Jul 20 20:03:10.664319 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:10.664289 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:10.664473 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:10.664348 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:11.664583 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:11.664545 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:11.665058 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:11.664601 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:12.664270 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:12.664237 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:12.664444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:12.664286 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:13.646150 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:13.646114 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:13.646457 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:13.646179 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:13.646457 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:13.646206 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:03:13.664470 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:13.664445 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:13.664561 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:13.664497 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:14.207565 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:14.207530 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" event={"ID":"059e6526-1b2e-4db2-9f3c-b249ed485471","Type":"ContainerStarted","Data":"490c39f18b128a8a4b56f178c9ffc8178c94eeadd248f7b1f9c3a4e7b48d47b0"} Jul 20 20:03:14.228350 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:14.228302 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" podStartSLOduration=1.565901545 podStartE2EDuration="14.228288168s" totalImagesPullingTime="12.662386623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:14.227228199 +0000 UTC m=+402.411075947" watchObservedRunningTime="2026-07-20 20:03:14.228288168 +0000 UTC m=+402.412135900" Jul 20 20:03:14.664096 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:14.664069 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 20:03:14.664443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:14.664123 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 20:03:14.825401 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:14.825366 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:14.829933 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:14.829911 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:15.212948 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:15.212916 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:15.213971 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:15.213951 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jrpd8" Jul 20 20:03:15.265561 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:15.265516 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg"] Jul 20 20:03:15.265745 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:15.265723 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" containerID="cri-o://d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7" gracePeriod=30 Jul 20 20:03:15.664483 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:15.664456 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:20.507070 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.507045 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:20.597628 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597555 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-credential-socket\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.597628 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597608 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-data\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.597816 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597641 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e663b6c-bb4d-4480-a94a-51b739b99789-istiod-ca-cert\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.597816 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597699 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zxp6\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-kube-api-access-7zxp6\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.597816 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597745 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-token\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.597972 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597812 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:20.597972 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597826 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:20.597972 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597867 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-envoy\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.597972 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597902 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-socket\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.598216 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.597992 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-podinfo\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.598216 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.598097 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-certs\") pod \"9e663b6c-bb4d-4480-a94a-51b739b99789\" (UID: \"9e663b6c-bb4d-4480-a94a-51b739b99789\") " Jul 20 20:03:20.598344 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.598303 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:20.598502 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.598478 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.598557 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.598508 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-credential-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.598557 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.598508 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:20.598557 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.598522 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-data\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.598557 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.598234 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e663b6c-bb4d-4480-a94a-51b739b99789-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:03:20.600513 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.600482 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:03:20.600622 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.600511 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-kube-api-access-7zxp6" (OuterVolumeSpecName: "kube-api-access-7zxp6") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "kube-api-access-7zxp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:03:20.600622 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.600524 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:03:20.600900 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.600878 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e663b6c-bb4d-4480-a94a-51b739b99789" (UID: "9e663b6c-bb4d-4480-a94a-51b739b99789"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:03:20.699574 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.699548 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zxp6\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-kube-api-access-7zxp6\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.699574 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.699570 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-token\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.699717 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.699580 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-envoy\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.699717 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.699588 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e663b6c-bb4d-4480-a94a-51b739b99789-istio-podinfo\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.699717 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.699594 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e663b6c-bb4d-4480-a94a-51b739b99789-workload-certs\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:20.699717 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:20.699602 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e663b6c-bb4d-4480-a94a-51b739b99789-istiod-ca-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:03:21.241836 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.241804 2559 generic.go:356] "Generic (PLEG): container finished" podID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerID="d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7" exitCode=0 Jul 20 20:03:21.242001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.241849 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" Jul 20 20:03:21.242001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.241897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" event={"ID":"9e663b6c-bb4d-4480-a94a-51b739b99789","Type":"ContainerDied","Data":"d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7"} Jul 20 20:03:21.242001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.241950 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg" event={"ID":"9e663b6c-bb4d-4480-a94a-51b739b99789","Type":"ContainerDied","Data":"07463c76bf77b660868b0de56cd1f646cafcd508737ddb996274239d58c60fa9"} Jul 20 20:03:21.242001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.241978 2559 scope.go:117] "RemoveContainer" containerID="d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7" Jul 20 20:03:21.250890 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.250874 2559 scope.go:117] "RemoveContainer" containerID="d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7" Jul 20 20:03:21.251147 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:03:21.251128 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7\": container with ID starting with d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7 not found: ID does not exist" containerID="d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7" Jul 20 20:03:21.251200 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.251156 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7"} err="failed to get container status \"d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7\": rpc error: code = NotFound desc = could not find container \"d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7\": container with ID starting with d076ab0c3989cee1b4ca3da2b94bbb1e73c6aed2c02269d0f6d06f3fe7d80fd7 not found: ID does not exist" Jul 20 20:03:21.264341 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.264319 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg"] Jul 20 20:03:21.271978 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:21.271958 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-9wpkg"] Jul 20 20:03:22.361844 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:22.361815 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" path="/var/lib/kubelet/pods/9e663b6c-bb4d-4480-a94a-51b739b99789/volumes" Jul 20 20:03:54.901680 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:54.901600 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:55.161883 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:55.161800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:55.223463 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:55.223435 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:55.826033 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:55.825984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:03:56.029144 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:03:56.029106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:14.354487 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:14.354455 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:23.089408 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.089383 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65569c5f5-cklwp"] Jul 20 20:04:23.089837 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.089714 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" Jul 20 20:04:23.089837 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.089724 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" Jul 20 20:04:23.089837 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.089807 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e663b6c-bb4d-4480-a94a-51b739b99789" containerName="istio-proxy" Jul 20 20:04:23.091805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.091786 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.105598 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.105575 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65569c5f5-cklwp"] Jul 20 20:04:23.159300 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.159272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:23.173766 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.173742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4qcq\" (UniqueName: \"kubernetes.io/projected/c41d3af2-a755-444b-a96b-6f3063eb2892-kube-api-access-k4qcq\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.173879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.173799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41d3af2-a755-444b-a96b-6f3063eb2892-console-serving-cert\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.173879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.173837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41d3af2-a755-444b-a96b-6f3063eb2892-console-oauth-config\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.173879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.173860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-oauth-serving-cert\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.174072 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.173930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-service-ca\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.174072 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.173965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-console-config\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.174072 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.173996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-trusted-ca-bundle\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.230519 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.230498 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:23.274608 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.274585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qcq\" (UniqueName: \"kubernetes.io/projected/c41d3af2-a755-444b-a96b-6f3063eb2892-kube-api-access-k4qcq\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.274686 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.274629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41d3af2-a755-444b-a96b-6f3063eb2892-console-serving-cert\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.274686 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.274644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41d3af2-a755-444b-a96b-6f3063eb2892-console-oauth-config\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.274686 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.274665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-oauth-serving-cert\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.274823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.274700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-service-ca\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.274823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.274727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-console-config\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.274823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.274758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-trusted-ca-bundle\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.275461 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.275442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-service-ca\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.275598 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.275574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-oauth-serving-cert\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.275723 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.275708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-trusted-ca-bundle\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.275757 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.275737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c41d3af2-a755-444b-a96b-6f3063eb2892-console-config\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.277185 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.277167 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c41d3af2-a755-444b-a96b-6f3063eb2892-console-oauth-config\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.277273 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.277223 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c41d3af2-a755-444b-a96b-6f3063eb2892-console-serving-cert\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.282396 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.282374 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4qcq\" (UniqueName: \"kubernetes.io/projected/c41d3af2-a755-444b-a96b-6f3063eb2892-kube-api-access-k4qcq\") pod \"console-65569c5f5-cklwp\" (UID: \"c41d3af2-a755-444b-a96b-6f3063eb2892\") " pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.294674 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.294648 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:23.400178 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.400158 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:23.533812 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.533787 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65569c5f5-cklwp"] Jul 20 20:04:23.535761 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:04:23.535737 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41d3af2_a755_444b_a96b_6f3063eb2892.slice/crio-099cd2488618b16c4eb71c45f53cc58f41bed2d8ae78cd8df31995a2d6240556 WatchSource:0}: Error finding container 099cd2488618b16c4eb71c45f53cc58f41bed2d8ae78cd8df31995a2d6240556: Status 404 returned error can't find the container with id 099cd2488618b16c4eb71c45f53cc58f41bed2d8ae78cd8df31995a2d6240556 Jul 20 20:04:23.891771 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.891741 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:23.990295 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:23.990267 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:24.521480 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:24.521450 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65569c5f5-cklwp" event={"ID":"c41d3af2-a755-444b-a96b-6f3063eb2892","Type":"ContainerStarted","Data":"61b37f322a7590e22e6ab2ab6546f15a2b1b2fcdc25b5d0943011874c468cfa4"} Jul 20 20:04:24.521904 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:24.521496 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65569c5f5-cklwp" event={"ID":"c41d3af2-a755-444b-a96b-6f3063eb2892","Type":"ContainerStarted","Data":"099cd2488618b16c4eb71c45f53cc58f41bed2d8ae78cd8df31995a2d6240556"} Jul 20 20:04:24.541604 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:24.541558 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65569c5f5-cklwp" podStartSLOduration=1.5415402409999999 podStartE2EDuration="1.541540241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:24.540945125 +0000 UTC m=+472.724792858" watchObservedRunningTime="2026-07-20 20:04:24.541540241 +0000 UTC m=+472.725387971" Jul 20 20:04:25.709633 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:25.709603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:29.289320 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:29.289287 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:30.285838 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:30.285810 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:33.400476 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:33.400447 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:33.400879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:33.400515 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:33.405043 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:33.404999 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:33.571330 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:33.571299 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65569c5f5-cklwp" Jul 20 20:04:33.620418 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:33.620394 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78977686cd-kql7g"] Jul 20 20:04:33.764498 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:33.764421 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:33.862787 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:33.862762 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:34.029170 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:34.029121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:34.123501 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:34.123475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:34.777462 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:34.777406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:34.878097 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:34.878042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:36.355588 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:36.355547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:36.707462 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:36.707433 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:37.573410 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:37.573374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:39.551538 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:39.551509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:42.523266 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:42.523237 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:42.623867 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:42.623838 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:44.312716 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:44.312681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:47.902197 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:47.902145 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:48.019556 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:48.019525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:48.315757 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:48.315679 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:48.419525 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:48.419491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:51.620327 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:51.620298 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:51.717642 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:51.717616 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:52.103747 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:52.103709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:52.204265 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:52.204236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:54.458325 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:54.458295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:54.559004 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:54.558974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:04:58.641240 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.641190 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78977686cd-kql7g" podUID="6fd0fc3f-687f-46c9-b113-170e97344802" containerName="console" containerID="cri-o://f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd" gracePeriod=15 Jul 20 20:04:58.884639 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.884615 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:04:58.961611 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961511 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-trusted-ca-bundle\") pod \"6fd0fc3f-687f-46c9-b113-170e97344802\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " Jul 20 20:04:58.961611 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961574 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-serving-cert\") pod \"6fd0fc3f-687f-46c9-b113-170e97344802\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " Jul 20 20:04:58.961848 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961643 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-oauth-config\") pod \"6fd0fc3f-687f-46c9-b113-170e97344802\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " Jul 20 20:04:58.961848 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961672 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-service-ca\") pod \"6fd0fc3f-687f-46c9-b113-170e97344802\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " Jul 20 20:04:58.961848 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961704 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-console-config\") pod \"6fd0fc3f-687f-46c9-b113-170e97344802\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " Jul 20 20:04:58.961848 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961728 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-oauth-serving-cert\") pod \"6fd0fc3f-687f-46c9-b113-170e97344802\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " Jul 20 20:04:58.961848 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961789 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lnr7\" (UniqueName: \"kubernetes.io/projected/6fd0fc3f-687f-46c9-b113-170e97344802-kube-api-access-9lnr7\") pod \"6fd0fc3f-687f-46c9-b113-170e97344802\" (UID: \"6fd0fc3f-687f-46c9-b113-170e97344802\") " Jul 20 20:04:58.962129 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.961964 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fd0fc3f-687f-46c9-b113-170e97344802" (UID: "6fd0fc3f-687f-46c9-b113-170e97344802"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:04:58.962184 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.962147 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-trusted-ca-bundle\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:04:58.962184 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.962141 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fd0fc3f-687f-46c9-b113-170e97344802" (UID: "6fd0fc3f-687f-46c9-b113-170e97344802"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:04:58.962184 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.962172 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fd0fc3f-687f-46c9-b113-170e97344802" (UID: "6fd0fc3f-687f-46c9-b113-170e97344802"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:04:58.962492 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.962462 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-console-config" (OuterVolumeSpecName: "console-config") pod "6fd0fc3f-687f-46c9-b113-170e97344802" (UID: "6fd0fc3f-687f-46c9-b113-170e97344802"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:04:58.963989 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.963957 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fd0fc3f-687f-46c9-b113-170e97344802" (UID: "6fd0fc3f-687f-46c9-b113-170e97344802"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:04:58.963989 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.963972 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fd0fc3f-687f-46c9-b113-170e97344802" (UID: "6fd0fc3f-687f-46c9-b113-170e97344802"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:04:58.964162 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:58.964131 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd0fc3f-687f-46c9-b113-170e97344802-kube-api-access-9lnr7" (OuterVolumeSpecName: "kube-api-access-9lnr7") pod "6fd0fc3f-687f-46c9-b113-170e97344802" (UID: "6fd0fc3f-687f-46c9-b113-170e97344802"). InnerVolumeSpecName "kube-api-access-9lnr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:04:59.063404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.063360 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lnr7\" (UniqueName: \"kubernetes.io/projected/6fd0fc3f-687f-46c9-b113-170e97344802-kube-api-access-9lnr7\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:04:59.063404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.063397 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:04:59.063404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.063421 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fd0fc3f-687f-46c9-b113-170e97344802-console-oauth-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:04:59.063664 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.063433 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:04:59.063664 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.063445 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-console-config\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:04:59.063664 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.063456 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fd0fc3f-687f-46c9-b113-170e97344802-oauth-serving-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:04:59.690732 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.690696 2559 generic.go:356] "Generic (PLEG): container finished" podID="6fd0fc3f-687f-46c9-b113-170e97344802" containerID="f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd" exitCode=0 Jul 20 20:04:59.691204 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.690741 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78977686cd-kql7g" Jul 20 20:04:59.691204 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.690784 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78977686cd-kql7g" event={"ID":"6fd0fc3f-687f-46c9-b113-170e97344802","Type":"ContainerDied","Data":"f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd"} Jul 20 20:04:59.691204 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.690838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78977686cd-kql7g" event={"ID":"6fd0fc3f-687f-46c9-b113-170e97344802","Type":"ContainerDied","Data":"94d4da1d357436f1c8d91a81baeae798f86533599b4051ac1f2ec457a6676676"} Jul 20 20:04:59.691204 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.690865 2559 scope.go:117] "RemoveContainer" containerID="f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd" Jul 20 20:04:59.699746 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.699733 2559 scope.go:117] "RemoveContainer" containerID="f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd" Jul 20 20:04:59.699995 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:04:59.699978 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd\": container with ID starting with f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd not found: ID does not exist" containerID="f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd" Jul 20 20:04:59.700086 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.700004 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd"} err="failed to get container status \"f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd\": rpc error: code = NotFound desc = could not find container \"f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd\": container with ID starting with f0f65fc798ef22971d2432e8657b08ec891463d3abcd4a7fb4b760aefd2edebd not found: ID does not exist" Jul 20 20:04:59.714196 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.714171 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78977686cd-kql7g"] Jul 20 20:04:59.718498 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:04:59.718474 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78977686cd-kql7g"] Jul 20 20:05:00.362356 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:00.362314 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd0fc3f-687f-46c9-b113-170e97344802" path="/var/lib/kubelet/pods/6fd0fc3f-687f-46c9-b113-170e97344802/volumes" Jul 20 20:05:01.169752 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:01.169680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:01.331920 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:01.331848 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:06.485644 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:06.485613 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:06.544539 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:06.544503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:06.886464 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:06.886408 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:06.947220 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:06.947175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:10.097686 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:10.097657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:10.195674 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:10.195646 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:12.843828 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:12.843747 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:12.945239 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:12.945162 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:24.819060 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:24.818946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:24.916404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:24.916361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:30.781518 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.781477 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r"] Jul 20 20:05:30.782060 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.781874 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd0fc3f-687f-46c9-b113-170e97344802" containerName="console" Jul 20 20:05:30.782060 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.781886 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd0fc3f-687f-46c9-b113-170e97344802" containerName="console" Jul 20 20:05:30.782060 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.781956 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd0fc3f-687f-46c9-b113-170e97344802" containerName="console" Jul 20 20:05:30.783904 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.783889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.786732 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.786708 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lxd6t\"" Jul 20 20:05:30.803872 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.803844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r"] Jul 20 20:05:30.808968 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.808948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:30.841173 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6895\" (UniqueName: \"kubernetes.io/projected/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-kube-api-access-h6895\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841316 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841316 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841316 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841316 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841316 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841316 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841511 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.841511 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.841404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942536 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942536 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6895\" (UniqueName: \"kubernetes.io/projected/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-kube-api-access-h6895\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.942805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.943214 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.942973 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.943214 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.943089 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.943214 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.943194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.943486 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.943218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.943486 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.943349 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.944980 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.944958 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.945217 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.945200 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.951200 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.951178 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:30.951541 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:30.951521 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6895\" (UniqueName: \"kubernetes.io/projected/76b4c9e7-a5d8-42a8-8789-92cb75daba7e-kube-api-access-h6895\") pod \"maas-default-gateway-openshift-default-56654dcf7-fp59r\" (UID: \"76b4c9e7-a5d8-42a8-8789-92cb75daba7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:31.094111 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.094010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:31.223805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.223774 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r"] Jul 20 20:05:31.226849 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:05:31.226824 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b4c9e7_a5d8_42a8_8789_92cb75daba7e.slice/crio-44d29edeeb5dfeca6e551eee6f73311e865741f4332346aa877587b48c66d52a WatchSource:0}: Error finding container 44d29edeeb5dfeca6e551eee6f73311e865741f4332346aa877587b48c66d52a: Status 404 returned error can't find the container with id 44d29edeeb5dfeca6e551eee6f73311e865741f4332346aa877587b48c66d52a Jul 20 20:05:31.228968 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.228882 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:05:31.229069 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.229028 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:05:31.229069 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.229062 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:05:31.282733 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.282681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:31.835231 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.835194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" event={"ID":"76b4c9e7-a5d8-42a8-8789-92cb75daba7e","Type":"ContainerStarted","Data":"7c542cf028e23df23098cbd06cac366b7279ca059857b80dd8e36eec83e56bc4"} Jul 20 20:05:31.835602 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.835252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" event={"ID":"76b4c9e7-a5d8-42a8-8789-92cb75daba7e","Type":"ContainerStarted","Data":"44d29edeeb5dfeca6e551eee6f73311e865741f4332346aa877587b48c66d52a"} Jul 20 20:05:31.859817 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:31.859767 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" podStartSLOduration=1.859747378 podStartE2EDuration="1.859747378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:05:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:05:31.857438011 +0000 UTC m=+540.041285756" watchObservedRunningTime="2026-07-20 20:05:31.859747378 +0000 UTC m=+540.043595112" Jul 20 20:05:32.094834 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:32.094756 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:32.099344 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:32.099318 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:32.839587 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:32.839553 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:32.840516 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:32.840497 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:05:38.184416 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:38.184386 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:42.830487 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:42.830450 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:46.165923 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.165890 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:46.279162 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.279135 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:46.339514 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.339483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:46.594900 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.594824 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:05:46.597753 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.597725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:46.600215 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.600190 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 20 20:05:46.600321 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.600198 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 20:05:46.600945 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.600925 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9q6r4\"" Jul 20 20:05:46.601067 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.600953 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 20:05:46.608287 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.608264 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:05:46.647488 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.647459 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:05:46.687683 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.687657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cptqn\" (UniqueName: \"kubernetes.io/projected/d56f3044-e269-4591-8b60-5b18990c73b7-kube-api-access-cptqn\") pod \"limitador-limitador-54d6d988d5-54jhs\" (UID: \"d56f3044-e269-4591-8b60-5b18990c73b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:46.687781 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.687769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d56f3044-e269-4591-8b60-5b18990c73b7-config-file\") pod \"limitador-limitador-54d6d988d5-54jhs\" (UID: \"d56f3044-e269-4591-8b60-5b18990c73b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:46.788290 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.788260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d56f3044-e269-4591-8b60-5b18990c73b7-config-file\") pod \"limitador-limitador-54d6d988d5-54jhs\" (UID: \"d56f3044-e269-4591-8b60-5b18990c73b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:46.788408 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.788347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cptqn\" (UniqueName: \"kubernetes.io/projected/d56f3044-e269-4591-8b60-5b18990c73b7-kube-api-access-cptqn\") pod \"limitador-limitador-54d6d988d5-54jhs\" (UID: \"d56f3044-e269-4591-8b60-5b18990c73b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:46.788924 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.788906 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d56f3044-e269-4591-8b60-5b18990c73b7-config-file\") pod \"limitador-limitador-54d6d988d5-54jhs\" (UID: \"d56f3044-e269-4591-8b60-5b18990c73b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:46.797049 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.797003 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cptqn\" (UniqueName: \"kubernetes.io/projected/d56f3044-e269-4591-8b60-5b18990c73b7-kube-api-access-cptqn\") pod \"limitador-limitador-54d6d988d5-54jhs\" (UID: \"d56f3044-e269-4591-8b60-5b18990c73b7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:46.909097 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:46.909073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:47.042111 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:47.042088 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:05:47.044323 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:05:47.044302 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56f3044_e269_4591_8b60_5b18990c73b7.slice/crio-753f1be2f28b67d7b30499caa2ecb95bfc29017b250f5d2256c967354754ff3b WatchSource:0}: Error finding container 753f1be2f28b67d7b30499caa2ecb95bfc29017b250f5d2256c967354754ff3b: Status 404 returned error can't find the container with id 753f1be2f28b67d7b30499caa2ecb95bfc29017b250f5d2256c967354754ff3b Jul 20 20:05:47.047536 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:47.047515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:47.135477 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:47.135447 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:05:47.913276 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:47.913242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" event={"ID":"d56f3044-e269-4591-8b60-5b18990c73b7","Type":"ContainerStarted","Data":"753f1be2f28b67d7b30499caa2ecb95bfc29017b250f5d2256c967354754ff3b"} Jul 20 20:05:49.925424 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:49.925395 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" event={"ID":"d56f3044-e269-4591-8b60-5b18990c73b7","Type":"ContainerStarted","Data":"36f97bd9b6ccbccd93d5fae11602315f2cd75f780c5ea7f0aeab1942277e552d"} Jul 20 20:05:49.925884 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:49.925500 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:05:49.949863 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:49.949818 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" podStartSLOduration=1.510487671 podStartE2EDuration="3.949804749s" totalImagesPullingTime="2.439317078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:05:49.94732072 +0000 UTC m=+558.131168453" watchObservedRunningTime="2026-07-20 20:05:49.949804749 +0000 UTC m=+558.133652553" Jul 20 20:05:53.910149 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:05:53.910112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:00.931122 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:00.931090 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-54jhs" Jul 20 20:06:04.472323 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:04.472281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:04.566676 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:04.566642 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:05.003758 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:05.003721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:17.050512 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:17.050467 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:17.535507 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:17.535475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:21.281217 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:21.281188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:24.620893 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:24.620860 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:24.699838 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:24.699806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:24.763363 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:24.763337 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:24.880439 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:24.880395 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:27.811106 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:27.811073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:06:27.904440 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:06:27.904411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:00.072074 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:00.071970 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:01.438061 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:01.438027 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:07:02.325456 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:02.325387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:09.307166 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:09.307131 2559 generic.go:356] "Generic (PLEG): container finished" podID="76b4c9e7-a5d8-42a8-8789-92cb75daba7e" containerID="7c542cf028e23df23098cbd06cac366b7279ca059857b80dd8e36eec83e56bc4" exitCode=0 Jul 20 20:07:09.307529 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:09.307177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" event={"ID":"76b4c9e7-a5d8-42a8-8789-92cb75daba7e","Type":"ContainerDied","Data":"7c542cf028e23df23098cbd06cac366b7279ca059857b80dd8e36eec83e56bc4"} Jul 20 20:07:09.307577 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:09.307547 2559 scope.go:117] "RemoveContainer" containerID="7c542cf028e23df23098cbd06cac366b7279ca059857b80dd8e36eec83e56bc4" Jul 20 20:07:09.308525 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:09.308498 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:07:09.308581 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:09.308563 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:07:09.308618 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:09.308596 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:07:10.317158 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:10.317116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" event={"ID":"76b4c9e7-a5d8-42a8-8789-92cb75daba7e","Type":"ContainerStarted","Data":"567cfcb7e23a93a6e3c57e55573b004c388b56fe2a0cc864cd8700284c34c16a"} Jul 20 20:07:10.669907 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:10.669878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:10.763495 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:10.763437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:11.094457 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:11.094426 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:07:11.094606 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:11.094590 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fp59r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 20 20:07:11.094655 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:11.094635 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" podUID="76b4c9e7-a5d8-42a8-8789-92cb75daba7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 20 20:07:12.095379 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:12.095343 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fp59r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 20 20:07:12.095753 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:12.095396 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" podUID="76b4c9e7-a5d8-42a8-8789-92cb75daba7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 20 20:07:13.095353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:13.095317 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fp59r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 20 20:07:13.095525 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:13.095372 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" podUID="76b4c9e7-a5d8-42a8-8789-92cb75daba7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 20 20:07:14.094898 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:14.094866 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fp59r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 20 20:07:14.095095 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:14.094918 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" podUID="76b4c9e7-a5d8-42a8-8789-92cb75daba7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 20 20:07:15.097743 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:15.097714 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:07:15.098130 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:15.097971 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:07:15.098700 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:15.098683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fp59r" Jul 20 20:07:15.681538 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:15.681507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:15.750090 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:15.750065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:24.348881 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:24.348850 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:24.747103 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:24.747069 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:07:34.256752 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:34.256705 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:35.148401 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:35.148365 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:07:47.214109 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:47.214073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:48.437960 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:48.437929 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:07:55.385882 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:55.385849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:07:57.039579 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:07:57.039541 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:08:02.231224 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.231185 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb"] Jul 20 20:08:02.233979 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.233956 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.236618 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.236599 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 20:08:02.237338 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.237319 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 20:08:02.237482 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.237464 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 20 20:08:02.237779 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.237760 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z9f7c\"" Jul 20 20:08:02.244132 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.244109 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb"] Jul 20 20:08:02.335247 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.335222 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:02.354976 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.354953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.355084 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.354983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.355135 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.355088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmb5g\" (UniqueName: \"kubernetes.io/projected/8c7d273e-e680-49c6-bf14-dc4b00d17a88-kube-api-access-dmb5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.355135 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.355122 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.355213 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.355142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.355213 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.355164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7d273e-e680-49c6-bf14-dc4b00d17a88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456283 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7d273e-e680-49c6-bf14-dc4b00d17a88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456666 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmb5g\" (UniqueName: \"kubernetes.io/projected/8c7d273e-e680-49c6-bf14-dc4b00d17a88-kube-api-access-dmb5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456718 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456690 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456718 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456707 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.456813 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.456797 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.458797 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.458779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c7d273e-e680-49c6-bf14-dc4b00d17a88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.459088 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.459070 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c7d273e-e680-49c6-bf14-dc4b00d17a88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.465276 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.465255 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmb5g\" (UniqueName: \"kubernetes.io/projected/8c7d273e-e680-49c6-bf14-dc4b00d17a88-kube-api-access-dmb5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzjbb\" (UID: \"8c7d273e-e680-49c6-bf14-dc4b00d17a88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.545083 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.545005 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:02.668889 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.668863 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:02.692135 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.692111 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb"] Jul 20 20:08:02.694038 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:08:02.693998 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7d273e_e680_49c6_bf14_dc4b00d17a88.slice/crio-012b46f22b6140b2357ff118bb6cb6a46dfd894e07ea1f53e84c7ed7217c8e81 WatchSource:0}: Error finding container 012b46f22b6140b2357ff118bb6cb6a46dfd894e07ea1f53e84c7ed7217c8e81: Status 404 returned error can't find the container with id 012b46f22b6140b2357ff118bb6cb6a46dfd894e07ea1f53e84c7ed7217c8e81 Jul 20 20:08:02.695409 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:02.695391 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 20:08:03.577644 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:03.577569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" event={"ID":"8c7d273e-e680-49c6-bf14-dc4b00d17a88","Type":"ContainerStarted","Data":"012b46f22b6140b2357ff118bb6cb6a46dfd894e07ea1f53e84c7ed7217c8e81"} Jul 20 20:08:04.546614 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:04.546574 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:08:04.583674 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:04.583645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" event={"ID":"8c7d273e-e680-49c6-bf14-dc4b00d17a88","Type":"ContainerStarted","Data":"2de18d23270742c06dcff4d41302c0b218d0c580a58712f4ee6d7748aabb708e"} Jul 20 20:08:04.602354 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:04.602293 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" podStartSLOduration=1.580266296 podStartE2EDuration="2.602278659s" totalImagesPullingTime="1.022012363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:08:04.601494593 +0000 UTC m=+692.785342353" watchObservedRunningTime="2026-07-20 20:08:04.602278659 +0000 UTC m=+692.786126389" Jul 20 20:08:12.545317 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:12.545281 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:12.545789 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:12.545346 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:12.557140 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:12.557120 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:12.632230 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:12.632209 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzjbb" Jul 20 20:08:47.111517 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:47.111413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:08:47.224372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:08:47.224341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:18.163496 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:18.163442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:20.538151 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:20.538114 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:09:25.417611 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:25.417559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:38.646240 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:38.646204 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:38.747106 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:38.747077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:39.948002 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:39.947973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:40.053336 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:40.053306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:09:43.109966 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:09:43.109929 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:10:07.544416 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:10:07.544341 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:10:20.031284 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:10:20.031250 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:10:28.934538 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:10:28.934509 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:11:47.362287 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:11:47.362254 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:11:48.567526 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:11:48.567490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:12.643007 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:12.642965 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:12:24.238283 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:24.238245 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:12:29.311810 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:29.311775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:31.030494 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:31.030459 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:35.995789 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:35.995751 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:36.108393 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:36.108363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:36.196854 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:36.196820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:36.365526 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:36.365461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:42.382806 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:42.382775 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:42.481778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:42.481749 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:12:59.740170 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:12:59.740097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:13:09.339092 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:09.339049 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:13:19.939322 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:19.939286 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:13:28.229330 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:28.229298 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:13:39.343937 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:39.343901 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:13:47.994978 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:47.994944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:13:50.831432 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:50.831397 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:13:50.898710 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:50.898683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:13:51.456709 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:13:51.456677 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:14:02.038145 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:14:02.038113 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:14:11.841680 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:14:11.841646 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:14:37.642418 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:14:37.642315 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:14:46.232047 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:14:46.231999 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:15:10.136147 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:15:10.136108 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:15:20.331888 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:15:20.331848 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:15:37.044222 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:15:37.044183 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:15:46.340508 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:15:46.340466 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:15:55.839923 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:15:55.839842 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:16:05.336800 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:16:05.336750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:16:14.351559 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:16:14.351519 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:16:14.431187 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:16:14.431152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:18:04.735739 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:18:04.735697 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:18:14.630770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:18:14.630733 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:18:27.244170 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:18:27.244123 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:18:38.743321 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:18:38.743280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:18:50.532167 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:18:50.532124 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:18:59.642855 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:18:59.642763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:19:09.029605 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:19:09.029562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:19:19.740026 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:19:19.739972 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:19:30.733392 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:19:30.733354 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:19:40.633884 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:19:40.633845 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:19:51.531776 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:19:51.531742 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:20:17.430278 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:17.430240 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:20:24.837115 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:24.837028 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:20:33.021096 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:33.021055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:20:34.719264 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:34.719217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:20:37.130160 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:37.130123 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:20:54.029619 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:54.029581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:20:54.367629 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:54.367546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:20:57.725779 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:20:57.725749 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:21:14.973294 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:21:14.973260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:21:15.360796 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:21:15.360708 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:21:18.047355 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:21:18.047316 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:21:31.330629 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:21:31.330599 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:21:40.929912 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:21:40.929874 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:21:53.133062 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:21:53.132973 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:22:04.539137 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:22:04.539105 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:22:13.642707 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:22:13.642663 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:22:22.840705 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:22:22.840669 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:22:33.551388 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:22:33.551351 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:22:43.034353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:22:43.034317 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:22:47.968639 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:22:47.968605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:22:56.045177 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:22:56.045134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:23:05.238264 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:23:05.238233 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:23:14.656291 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:23:14.656253 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:23:27.328297 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:23:27.328215 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:23:37.148532 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:23:37.148493 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:23:47.635588 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:23:47.635550 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:24:00.028640 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:00.028603 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:24:14.575885 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:14.575848 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:24:28.067443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:28.067410 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:24:31.018528 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:31.018488 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:24:39.102136 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:39.102095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:24:42.933649 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:42.933619 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:24:51.147626 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:51.147593 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:24:51.663816 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:51.663788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:24:56.525061 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:56.524959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:24:59.760237 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:59.760204 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:24:59.940188 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:59.940157 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:24:59.952800 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:24:59.952772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:00.372655 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:00.372626 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:07.757287 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:07.757228 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:07.862895 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:07.862855 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:08.026198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.026104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:08.369586 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.369499 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd"] Jul 20 20:25:08.372999 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.372969 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.376241 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.376223 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8d5e1ae9-openshift-default-dockercfg-mthpx\"" Jul 20 20:25:08.392066 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.392035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:08.407200 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.407173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd"] Jul 20 20:25:08.474829 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.474796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-podinfo\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.474829 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.474827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istiod-ca-cert\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.475056 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.475036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-envoy\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.475123 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.475078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-data\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.475123 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.475096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqnld\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-kube-api-access-cqnld\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.475229 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.475138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-token\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.475229 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.475181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-certs\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.475345 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.475232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-credential-socket\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.475345 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.475303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-socket\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.492141 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.492100 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:08.576078 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-podinfo\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576078 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istiod-ca-cert\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-envoy\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576158 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-data\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576174 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqnld\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-kube-api-access-cqnld\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576215 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-token\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-certs\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-credential-socket\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-socket\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576871 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576849 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-data\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.576942 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.576891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-certs\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.577064 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.577046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-credential-socket\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.577295 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.577118 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istiod-ca-cert\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.577295 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.577118 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-socket\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.578747 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.578729 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-podinfo\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.578869 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.578823 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-envoy\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.588724 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.588701 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-token\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.588819 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.588798 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqnld\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-kube-api-access-cqnld\") pod \"e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.684127 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.684098 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:08.836034 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.835982 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd"] Jul 20 20:25:08.839171 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:25:08.839142 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a9f81f_3091_4ed1_acd6_5702c6adb54c.slice/crio-3041c68b238cfba06b61f8aa08d19246d53c5be4952b12891e81ad7cdd1ba1bb WatchSource:0}: Error finding container 3041c68b238cfba06b61f8aa08d19246d53c5be4952b12891e81ad7cdd1ba1bb: Status 404 returned error can't find the container with id 3041c68b238cfba06b61f8aa08d19246d53c5be4952b12891e81ad7cdd1ba1bb Jul 20 20:25:08.841282 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.841253 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:08.841345 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.841315 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:08.841345 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:08.841340 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:09.468620 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:09.468577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" event={"ID":"a0a9f81f-3091-4ed1-acd6-5702c6adb54c","Type":"ContainerStarted","Data":"49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3"} Jul 20 20:25:09.468807 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:09.468642 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" event={"ID":"a0a9f81f-3091-4ed1-acd6-5702c6adb54c","Type":"ContainerStarted","Data":"3041c68b238cfba06b61f8aa08d19246d53c5be4952b12891e81ad7cdd1ba1bb"} Jul 20 20:25:09.499626 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:09.499580 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" podStartSLOduration=1.499563451 podStartE2EDuration="1.499563451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:25:09.498076 +0000 UTC m=+1717.681923756" watchObservedRunningTime="2026-07-20 20:25:09.499563451 +0000 UTC m=+1717.683411182" Jul 20 20:25:09.684949 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:09.684908 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:09.690274 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:09.690247 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:10.473900 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:10.473866 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:10.474985 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:10.474969 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:10.995024 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:10.994990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:11.198037 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:11.197988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:11.369238 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:11.369154 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:12.423699 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:12.423656 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:13.181148 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:13.181113 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:17.057188 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:17.057153 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:25:24.552384 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:24.552283 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerID="49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3" exitCode=0 Jul 20 20:25:24.552384 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:24.552366 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" event={"ID":"a0a9f81f-3091-4ed1-acd6-5702c6adb54c","Type":"ContainerDied","Data":"49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3"} Jul 20 20:25:24.552804 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:24.552754 2559 scope.go:117] "RemoveContainer" containerID="49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3" Jul 20 20:25:24.553667 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:24.553645 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:24.553725 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:24.553712 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:24.553761 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:24.553743 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:25.474202 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:25.474162 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:25.558802 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:25.558760 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" event={"ID":"a0a9f81f-3091-4ed1-acd6-5702c6adb54c","Type":"ContainerStarted","Data":"27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d"} Jul 20 20:25:25.684405 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:25.684372 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:25.685504 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:25.685480 2559 patch_prober.go:28] interesting pod/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:25:25.685608 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:25.685530 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 20 20:25:26.684422 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:26.684389 2559 patch_prober.go:28] interesting pod/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:25:26.684792 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:26.684469 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 20 20:25:27.684740 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:27.684704 2559 patch_prober.go:28] interesting pod/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:25:27.685143 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:27.684756 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 20 20:25:28.684698 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:28.684663 2559 patch_prober.go:28] interesting pod/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 20 20:25:28.684877 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:28.684716 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 20 20:25:29.688504 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:29.688477 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:29.688884 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:29.688716 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:29.689384 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:29.689369 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:47.071969 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:47.071933 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:49.950075 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:49.950041 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:25:51.585102 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:51.585062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:51.747558 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:51.747527 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd"] Jul 20 20:25:51.747820 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:51.747792 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" containerID="cri-o://27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d" gracePeriod=30 Jul 20 20:25:51.779335 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:51.779301 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:52.033408 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.033378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:52.288653 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.288575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:52.451542 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.451508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:52.582861 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.582783 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:52.829277 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.829249 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh"] Jul 20 20:25:52.832375 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.832359 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.834683 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.834628 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-03a646a1-gw-openshift-default-dockercfg-9xrkg\"" Jul 20 20:25:52.854134 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.854113 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh"] Jul 20 20:25:52.854731 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.854707 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:52.992222 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-envoy\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992425 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-token\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992425 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:52.992425 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-data\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992425 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lllzk\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-kube-api-access-lllzk\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992616 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97cb1907-741c-4809-88a8-ae9a45f9981a-istiod-ca-cert\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992616 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-credential-socket\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992616 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-podinfo\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992773 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-certs\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:52.992773 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:52.992639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-socket\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.093713 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-podinfo\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.093713 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-certs\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.093713 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-socket\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-envoy\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-token\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-data\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lllzk\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-kube-api-access-lllzk\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97cb1907-741c-4809-88a8-ae9a45f9981a-istiod-ca-cert\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094001 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.093937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-credential-socket\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.094226 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-certs\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.094297 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-data\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094470 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.094365 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-socket\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094470 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.094376 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-credential-socket\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.094823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.094799 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97cb1907-741c-4809-88a8-ae9a45f9981a-istiod-ca-cert\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.096165 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.096143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-envoy\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.096360 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.096342 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-podinfo\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.109165 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.109141 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lllzk\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-kube-api-access-lllzk\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.110200 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.110183 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-token\") pod \"e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.142742 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.142719 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:53.280244 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.280220 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh"] Jul 20 20:25:53.282571 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:25:53.282549 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cb1907_741c_4809_88a8_ae9a45f9981a.slice/crio-b422f5bafcb3d63981fc1a59a2a516300e280d9dea846ad529e7daf9846f932b WatchSource:0}: Error finding container b422f5bafcb3d63981fc1a59a2a516300e280d9dea846ad529e7daf9846f932b: Status 404 returned error can't find the container with id b422f5bafcb3d63981fc1a59a2a516300e280d9dea846ad529e7daf9846f932b Jul 20 20:25:53.284675 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.284646 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:53.284737 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.284707 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:53.284774 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.284735 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:25:53.686315 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.686274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" event={"ID":"97cb1907-741c-4809-88a8-ae9a45f9981a","Type":"ContainerStarted","Data":"1902c0c2f42a8ba495a458df082d9ac3379f4466f615ba378c0cfed4bd266392"} Jul 20 20:25:53.686485 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.686346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" event={"ID":"97cb1907-741c-4809-88a8-ae9a45f9981a","Type":"ContainerStarted","Data":"b422f5bafcb3d63981fc1a59a2a516300e280d9dea846ad529e7daf9846f932b"} Jul 20 20:25:53.711795 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:53.711734 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" podStartSLOduration=1.711715135 podStartE2EDuration="1.711715135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:25:53.708691342 +0000 UTC m=+1761.892539074" watchObservedRunningTime="2026-07-20 20:25:53.711715135 +0000 UTC m=+1761.895562868" Jul 20 20:25:54.143107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:54.143077 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:54.147723 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:54.147698 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:54.692735 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:54.692704 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:54.693671 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:54.693653 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:25:55.301368 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:55.301337 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:55.587487 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:55.587402 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:56.275007 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:56.274942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:56.407425 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:56.407391 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:56.534947 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:56.534798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:25:56.997280 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:56.997258 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:57.033568 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033541 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-token\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.033704 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033610 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-credential-socket\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.033704 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033668 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-socket\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.033833 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033713 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istiod-ca-cert\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.033833 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033744 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-certs\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.033833 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033793 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-envoy\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.033833 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033824 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-podinfo\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.034052 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033873 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqnld\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-kube-api-access-cqnld\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.034052 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.033898 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-data\") pod \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\" (UID: \"a0a9f81f-3091-4ed1-acd6-5702c6adb54c\") " Jul 20 20:25:57.034052 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.034002 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:25:57.034701 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.034130 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:25:57.034701 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.034329 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-credential-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.034815 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.034718 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.034869 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.034816 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:25:57.035227 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.035192 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:25:57.035319 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.035269 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:25:57.036671 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.036643 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:25:57.036774 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.036674 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:25:57.036835 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.036800 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:25:57.037247 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.037231 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-kube-api-access-cqnld" (OuterVolumeSpecName: "kube-api-access-cqnld") pod "a0a9f81f-3091-4ed1-acd6-5702c6adb54c" (UID: "a0a9f81f-3091-4ed1-acd6-5702c6adb54c"). InnerVolumeSpecName "kube-api-access-cqnld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:25:57.135578 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.135556 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istiod-ca-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.135578 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.135578 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-workload-certs\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.135728 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.135586 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-envoy\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.135728 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.135594 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-podinfo\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.135728 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.135604 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqnld\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-kube-api-access-cqnld\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.135728 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.135613 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-data\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.135728 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.135621 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0a9f81f-3091-4ed1-acd6-5702c6adb54c-istio-token\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:25:57.708398 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.708363 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerID="27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d" exitCode=0 Jul 20 20:25:57.708751 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.708411 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" Jul 20 20:25:57.708751 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.708445 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" event={"ID":"a0a9f81f-3091-4ed1-acd6-5702c6adb54c","Type":"ContainerDied","Data":"27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d"} Jul 20 20:25:57.708751 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.708502 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd" event={"ID":"a0a9f81f-3091-4ed1-acd6-5702c6adb54c","Type":"ContainerDied","Data":"3041c68b238cfba06b61f8aa08d19246d53c5be4952b12891e81ad7cdd1ba1bb"} Jul 20 20:25:57.708751 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.708524 2559 scope.go:117] "RemoveContainer" containerID="27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d" Jul 20 20:25:57.719857 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.719841 2559 scope.go:117] "RemoveContainer" containerID="49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3" Jul 20 20:25:57.727774 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.727757 2559 scope.go:117] "RemoveContainer" containerID="27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d" Jul 20 20:25:57.728007 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:25:57.727989 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d\": container with ID starting with 27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d not found: ID does not exist" containerID="27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d" Jul 20 20:25:57.728073 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.728034 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d"} err="failed to get container status \"27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d\": rpc error: code = NotFound desc = could not find container \"27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d\": container with ID starting with 27ebf0e257830fdafe5eaf8c0a9d8843853ef5ef7e55ae49000bdc626322741d not found: ID does not exist" Jul 20 20:25:57.728073 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.728054 2559 scope.go:117] "RemoveContainer" containerID="49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3" Jul 20 20:25:57.728431 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:25:57.728338 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3\": container with ID starting with 49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3 not found: ID does not exist" containerID="49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3" Jul 20 20:25:57.728431 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.728372 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3"} err="failed to get container status \"49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3\": rpc error: code = NotFound desc = could not find container \"49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3\": container with ID starting with 49399102aca242db145513368cbc822dd36ff01b76351f73cdf371b10d6138e3 not found: ID does not exist" Jul 20 20:25:57.735697 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.735629 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd"] Jul 20 20:25:57.737982 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:57.737959 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8d5e1ae9-openshift-default-78b4db576c-svfrd"] Jul 20 20:25:58.362063 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:25:58.362031 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" path="/var/lib/kubelet/pods/a0a9f81f-3091-4ed1-acd6-5702c6adb54c/volumes" Jul 20 20:26:02.243118 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:02.243085 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:26:02.336596 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:02.336562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:02.402278 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:02.402252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:09.693862 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.693836 2559 patch_prober.go:28] interesting pod/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:26:09.694198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.693897 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 20:26:09.765933 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.765908 2559 generic.go:356] "Generic (PLEG): container finished" podID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerID="1902c0c2f42a8ba495a458df082d9ac3379f4466f615ba378c0cfed4bd266392" exitCode=0 Jul 20 20:26:09.766047 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.765983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" event={"ID":"97cb1907-741c-4809-88a8-ae9a45f9981a","Type":"ContainerDied","Data":"1902c0c2f42a8ba495a458df082d9ac3379f4466f615ba378c0cfed4bd266392"} Jul 20 20:26:09.766374 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.766358 2559 scope.go:117] "RemoveContainer" containerID="1902c0c2f42a8ba495a458df082d9ac3379f4466f615ba378c0cfed4bd266392" Jul 20 20:26:09.767375 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.767352 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:26:09.767432 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.767411 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:26:09.767465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:09.767439 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:26:10.772823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:10.772783 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" event={"ID":"97cb1907-741c-4809-88a8-ae9a45f9981a","Type":"ContainerStarted","Data":"f3e998c878e903788e586a04f65752be0ed944ae99924e469f0ebfa727672a1b"} Jul 20 20:26:11.143860 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:11.143817 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:26:11.144053 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:11.144001 2559 patch_prober.go:28] interesting pod/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:26:11.144124 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:11.144102 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 20:26:12.143352 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:12.143319 2559 patch_prober.go:28] interesting pod/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:26:12.143729 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:12.143386 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 20:26:13.143915 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:13.143870 2559 patch_prober.go:28] interesting pod/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:26:13.144326 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:13.143936 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 20:26:14.143637 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:14.143599 2559 patch_prober.go:28] interesting pod/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 20 20:26:14.143818 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:14.143656 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 20 20:26:15.147512 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:15.147479 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:26:15.147864 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:15.147737 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:26:15.148444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:15.148423 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:26:31.186882 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:31.186842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:34.235588 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:34.235553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:26:35.568748 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:35.568714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:35.754182 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:35.754148 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh"] Jul 20 20:26:35.754436 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:35.754410 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" containerID="cri-o://f3e998c878e903788e586a04f65752be0ed944ae99924e469f0ebfa727672a1b" gracePeriod=30 Jul 20 20:26:35.794755 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:35.794726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:36.009365 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:36.009332 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:36.280835 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:36.280738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:36.672886 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:36.672843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:36.771501 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:36.771467 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:40.919554 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:40.919522 2559 generic.go:356] "Generic (PLEG): container finished" podID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerID="f3e998c878e903788e586a04f65752be0ed944ae99924e469f0ebfa727672a1b" exitCode=0 Jul 20 20:26:40.919918 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:40.919596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" event={"ID":"97cb1907-741c-4809-88a8-ae9a45f9981a","Type":"ContainerDied","Data":"f3e998c878e903788e586a04f65752be0ed944ae99924e469f0ebfa727672a1b"} Jul 20 20:26:40.919918 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:40.919659 2559 scope.go:117] "RemoveContainer" containerID="1902c0c2f42a8ba495a458df082d9ac3379f4466f615ba378c0cfed4bd266392" Jul 20 20:26:40.998464 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:40.998444 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:26:41.046560 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046481 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97cb1907-741c-4809-88a8-ae9a45f9981a-istiod-ca-cert\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.046560 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046526 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-envoy\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.046770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046565 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-token\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.046770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046600 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-data\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.046770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046625 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lllzk\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-kube-api-access-lllzk\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.046770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046647 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-certs\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.046770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046689 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-credential-socket\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.046770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046733 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-socket\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.047081 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046790 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-podinfo\") pod \"97cb1907-741c-4809-88a8-ae9a45f9981a\" (UID: \"97cb1907-741c-4809-88a8-ae9a45f9981a\") " Jul 20 20:26:41.047081 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.046921 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97cb1907-741c-4809-88a8-ae9a45f9981a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:26:41.047180 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.047143 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97cb1907-741c-4809-88a8-ae9a45f9981a-istiod-ca-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.047263 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.047239 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:26:41.047366 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.047276 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:26:41.047366 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.047337 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:26:41.048309 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.048270 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-data" (OuterVolumeSpecName: "istio-data") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:26:41.049099 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.049071 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:26:41.049244 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.049213 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-kube-api-access-lllzk" (OuterVolumeSpecName: "kube-api-access-lllzk") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "kube-api-access-lllzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:26:41.049244 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.049222 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-token" (OuterVolumeSpecName: "istio-token") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:26:41.049378 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.049259 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97cb1907-741c-4809-88a8-ae9a45f9981a" (UID: "97cb1907-741c-4809-88a8-ae9a45f9981a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:26:41.148000 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.147968 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-envoy\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.148000 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.147996 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-token\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.148198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.148008 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-data\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.148198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.148048 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lllzk\" (UniqueName: \"kubernetes.io/projected/97cb1907-741c-4809-88a8-ae9a45f9981a-kube-api-access-lllzk\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.148198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.148062 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-certs\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.148198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.148075 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-credential-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.148198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.148086 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97cb1907-741c-4809-88a8-ae9a45f9981a-workload-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.148198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.148097 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97cb1907-741c-4809-88a8-ae9a45f9981a-istio-podinfo\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:26:41.916731 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.916686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:41.925381 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.925360 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" Jul 20 20:26:41.925719 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.925396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh" event={"ID":"97cb1907-741c-4809-88a8-ae9a45f9981a","Type":"ContainerDied","Data":"b422f5bafcb3d63981fc1a59a2a516300e280d9dea846ad529e7daf9846f932b"} Jul 20 20:26:41.925719 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.925458 2559 scope.go:117] "RemoveContainer" containerID="f3e998c878e903788e586a04f65752be0ed944ae99924e469f0ebfa727672a1b" Jul 20 20:26:41.974103 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.974080 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh"] Jul 20 20:26:41.983484 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:41.983458 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-03a646a1-gw-openshift-default-995884cf-l7xvh"] Jul 20 20:26:42.139454 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:42.139407 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:42.285659 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:42.285585 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:42.363837 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:42.363809 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" path="/var/lib/kubelet/pods/97cb1907-741c-4809-88a8-ae9a45f9981a/volumes" Jul 20 20:26:42.418544 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:42.418513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:42.836724 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:42.836691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:42.933788 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:42.933756 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:26:46.060638 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:26:46.060605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:27:11.518035 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:11.517989 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:11.616910 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:11.616876 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:18.513069 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:18.513008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:18.613068 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:18.612966 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:18.877871 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:18.877840 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:21.946707 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:21.946670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:27:23.010390 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:23.010351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:24.259491 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:24.259452 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:24.489682 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:24.489647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:24.730824 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:24.730790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:25.107859 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:25.107785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:25.294798 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:25.294767 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:27.194858 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:27.194821 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:27.362755 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:27.362715 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:27.544079 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:27.543968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:27.774564 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:27.774530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:28.052761 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:28.052726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:28.152100 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:28.152068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:27:32.654131 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:27:32.654099 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:28:02.667115 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:02.667034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:04.248212 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:04.248176 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:28:07.184289 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:07.184249 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:07.409404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:07.409372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:07.646232 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:07.646198 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:08.157061 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:08.157008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:08.250987 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:08.250946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:08.520363 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:08.520277 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:09.978301 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:09.978266 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:17.522129 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:17.522092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:17.623324 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:17.623282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:17.728853 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:17.728821 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:17.832645 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:17.832572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:18.355773 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:18.355738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:37.280942 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:37.280893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:37.372876 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:37.372843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:44.403367 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:44.403326 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:52.433545 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:52.433509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:52.571942 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:52.571903 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:28:52.710137 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:28:52.710064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:08.630999 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:08.630963 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:14.606606 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:14.606559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:14.762525 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:14.762494 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:14.892911 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:14.892882 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:25.418110 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:25.418023 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:26.250718 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:26.250681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:33.371769 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:33.371733 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:33.484240 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:33.484205 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:33.579242 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:33.579206 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:33.715670 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:33.715638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:34.591406 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:34.591376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:34.688223 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:34.688189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:36.528948 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:36.528903 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:42.759468 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:42.759434 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:29:43.468085 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:43.468047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:43.563934 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:43.563900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:44.157660 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:44.157628 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:50.344062 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:50.344024 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:29:51.624691 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:51.624663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:51.744589 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:51.744562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:51.920624 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:51.920594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:52.348401 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:52.348319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:52.585478 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:52.585451 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:55.431128 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:55.431091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:55.568542 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:55.568505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:55.705326 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:55.705235 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:55.891582 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:55.891543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:56.407669 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:56.407611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:29:56.632310 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:29:56.632281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:00.008330 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:00.008292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:00.681206 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:00.681171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:00.791247 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:00.791220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:01.155900 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:01.155875 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:02.186264 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:02.186230 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:30:07.886407 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:07.886364 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:08.033882 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:08.033859 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:18.901257 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:18.901223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:21.852707 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:21.852673 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:30:23.402033 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:23.401988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:23.804961 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:23.804883 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:23.944027 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:23.943977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:30.264698 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:30.264657 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:30.401223 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:30.401186 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:30.616383 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:30.616290 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:30.871450 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:30.871375 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:31.025477 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:31.025440 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:31.223107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:31.223058 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:31.344321 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:31.344291 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:37.963631 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:37.963592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:38.121338 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:38.121309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:38.238572 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:38.238493 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:38.336097 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:38.336068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:44.566620 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:44.566586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:44.677879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:44.677838 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:51.675595 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:51.675561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:53.810806 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:53.810710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:54.672319 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:54.672278 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:54.802357 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:54.802327 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:54.934881 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:54.934796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:55.188841 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:55.188764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:55.609577 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:55.609497 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:55.854794 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:55.854762 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:30:59.195580 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:30:59.195548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:31:01.291303 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:31:01.291270 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:31:03.760961 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:31:03.760914 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:31:13.264527 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:31:13.264495 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:31:36.362440 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:31:36.362411 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:31:57.031739 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:31:57.031704 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:31:58.721832 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:31:58.721796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:03.270428 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:03.270389 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:05.582739 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:05.582710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:07.931822 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:07.931785 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:32:10.684038 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:10.683985 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:12.274164 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:12.274128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:12.374694 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:12.374664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:15.814252 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:15.814217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:31.088916 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:31.088809 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:32.182512 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:32.182476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:38.404499 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:38.404462 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:32:40.568641 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:32:40.568608 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:02.734950 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:02.734912 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:02.801613 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:02.801587 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:03.039259 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:03.039162 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:03.270225 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:03.270184 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:04.477278 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:04.477243 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:04.591447 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:04.591412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:05.442728 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:05.442691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:05.538736 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:05.538694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:05.638452 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:05.638416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:07.075372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:07.075343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:13.058288 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:13.058253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:13.157092 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:13.157044 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:13.256411 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:13.256370 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:33:13.727000 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:13.726961 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:20.260979 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:20.260935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:20.374269 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:20.374227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:20.465449 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:20.465412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:21.548417 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:21.548382 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:33:31.039129 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:31.039069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:31.404728 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:31.404692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:52.341141 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:52.341102 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:59.115383 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:59.115279 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:59.219462 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:59.219430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:59.457570 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:59.457539 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:33:59.834750 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:33:59.834649 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:00.112525 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:00.112439 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:02.503612 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:02.503535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:02.608306 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:02.608274 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:02.695439 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:02.695406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:02.805620 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:02.805542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:03.195748 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:03.195713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:03.300666 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:03.300637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:06.733089 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:06.733059 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:34:07.093942 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:07.093864 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:07.419767 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:07.419733 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:07.759904 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:07.759825 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:08.009969 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:08.009884 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:10.562646 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.562614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:10.671430 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.671396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:10.683841 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.683813 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf"] Jul 20 20:34:10.684283 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684254 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" Jul 20 20:34:10.684283 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684272 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684289 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684294 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684302 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684307 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684313 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684318 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684376 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684388 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684395 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a9f81f-3091-4ed1-acd6-5702c6adb54c" containerName="istio-proxy" Jul 20 20:34:10.684465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.684403 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="97cb1907-741c-4809-88a8-ae9a45f9981a" containerName="istio-proxy" Jul 20 20:34:10.687586 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.687570 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.690797 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.690780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 20:34:10.690890 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.690782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-183471-serving-cert\"" Jul 20 20:34:10.691415 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.691397 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\"" Jul 20 20:34:10.691523 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.691402 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 20:34:10.697697 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.697675 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf"] Jul 20 20:34:10.754905 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.754880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:10.843754 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.843690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673e230-4ab7-4a84-a13a-9d29ba355942-openshift-service-ca\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.843861 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.843761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsq87\" (UniqueName: \"kubernetes.io/projected/c673e230-4ab7-4a84-a13a-9d29ba355942-kube-api-access-nsq87\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.843861 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.843855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c673e230-4ab7-4a84-a13a-9d29ba355942-maas-api-tls\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.871941 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.871912 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:10.944618 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.944588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c673e230-4ab7-4a84-a13a-9d29ba355942-maas-api-tls\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.944746 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.944677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673e230-4ab7-4a84-a13a-9d29ba355942-openshift-service-ca\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.944809 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.944748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsq87\" (UniqueName: \"kubernetes.io/projected/c673e230-4ab7-4a84-a13a-9d29ba355942-kube-api-access-nsq87\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.945385 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.945332 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673e230-4ab7-4a84-a13a-9d29ba355942-openshift-service-ca\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.947184 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.947164 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c673e230-4ab7-4a84-a13a-9d29ba355942-maas-api-tls\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.958740 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.958721 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsq87\" (UniqueName: \"kubernetes.io/projected/c673e230-4ab7-4a84-a13a-9d29ba355942-kube-api-access-nsq87\") pod \"maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:10.998292 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:10.998267 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:11.129517 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:11.129492 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf"] Jul 20 20:34:11.131576 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:34:11.131550 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc673e230_4ab7_4a84_a13a_9d29ba355942.slice/crio-12ba6aff1383fed3011c0181def6d974dbb6ce35c360fa736fb491dd073de232 WatchSource:0}: Error finding container 12ba6aff1383fed3011c0181def6d974dbb6ce35c360fa736fb491dd073de232: Status 404 returned error can't find the container with id 12ba6aff1383fed3011c0181def6d974dbb6ce35c360fa736fb491dd073de232 Jul 20 20:34:11.132875 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:11.132859 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 20:34:11.465328 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:11.465248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:11.549860 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:11.549824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:11.993474 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:11.993435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" event={"ID":"c673e230-4ab7-4a84-a13a-9d29ba355942","Type":"ContainerStarted","Data":"12ba6aff1383fed3011c0181def6d974dbb6ce35c360fa736fb491dd073de232"} Jul 20 20:34:14.004368 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:14.004337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" event={"ID":"c673e230-4ab7-4a84-a13a-9d29ba355942","Type":"ContainerStarted","Data":"d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307"} Jul 20 20:34:14.004733 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:14.004390 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:14.021328 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:14.021287 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" podStartSLOduration=1.847343175 podStartE2EDuration="4.021274204s" totalImagesPullingTime="2.173931029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:34:14.02041818 +0000 UTC m=+2262.204265936" watchObservedRunningTime="2026-07-20 20:34:14.021274204 +0000 UTC m=+2262.205121936" Jul 20 20:34:15.069836 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:15.069802 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:20.014669 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:20.014640 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:34:21.540685 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:21.540643 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:34:24.233555 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:24.233514 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:24.333319 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:24.333286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:32.265547 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:32.265461 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:32.366961 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:32.366923 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:37.448798 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:37.448760 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:34:40.530932 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:40.530898 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:34:52.127335 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:34:52.127302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:35:05.818710 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:05.818676 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:35:11.126100 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:11.126067 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:35:32.362887 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:32.362809 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:35:45.139088 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:45.139056 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:35:46.045616 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:46.045579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:35:46.667696 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:46.667664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:35:46.768464 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:46.768434 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:35:51.735369 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:51.735332 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:35:55.019075 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:55.019046 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:35:57.415138 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:35:57.415097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:00.934367 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:00.934332 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:36:01.252405 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:01.252323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:01.659961 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:01.659905 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:05.934033 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:05.933984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:07.839738 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:07.839703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:07.904444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:07.904418 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:08.112612 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:08.112534 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:08.387416 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:08.387386 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:09.270736 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:09.270701 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:09.370706 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:09.370678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:18.884198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:18.884164 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf"] Jul 20 20:36:18.886578 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:18.884818 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" podUID="c673e230-4ab7-4a84-a13a-9d29ba355942" containerName="maas-api" containerID="cri-o://d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307" gracePeriod=30 Jul 20 20:36:18.911319 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:18.911291 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:19.125145 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.125124 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:36:19.260158 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.260096 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c673e230-4ab7-4a84-a13a-9d29ba355942-maas-api-tls\") pod \"c673e230-4ab7-4a84-a13a-9d29ba355942\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " Jul 20 20:36:19.260158 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.260138 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673e230-4ab7-4a84-a13a-9d29ba355942-openshift-service-ca\") pod \"c673e230-4ab7-4a84-a13a-9d29ba355942\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " Jul 20 20:36:19.260317 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.260209 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsq87\" (UniqueName: \"kubernetes.io/projected/c673e230-4ab7-4a84-a13a-9d29ba355942-kube-api-access-nsq87\") pod \"c673e230-4ab7-4a84-a13a-9d29ba355942\" (UID: \"c673e230-4ab7-4a84-a13a-9d29ba355942\") " Jul 20 20:36:19.260550 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.260520 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c673e230-4ab7-4a84-a13a-9d29ba355942-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c673e230-4ab7-4a84-a13a-9d29ba355942" (UID: "c673e230-4ab7-4a84-a13a-9d29ba355942"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:36:19.262414 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.262391 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c673e230-4ab7-4a84-a13a-9d29ba355942-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c673e230-4ab7-4a84-a13a-9d29ba355942" (UID: "c673e230-4ab7-4a84-a13a-9d29ba355942"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:36:19.262490 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.262395 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c673e230-4ab7-4a84-a13a-9d29ba355942-kube-api-access-nsq87" (OuterVolumeSpecName: "kube-api-access-nsq87") pod "c673e230-4ab7-4a84-a13a-9d29ba355942" (UID: "c673e230-4ab7-4a84-a13a-9d29ba355942"). InnerVolumeSpecName "kube-api-access-nsq87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:36:19.361565 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.361544 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c673e230-4ab7-4a84-a13a-9d29ba355942-maas-api-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:36:19.361565 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.361565 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673e230-4ab7-4a84-a13a-9d29ba355942-openshift-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:36:19.361680 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.361575 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsq87\" (UniqueName: \"kubernetes.io/projected/c673e230-4ab7-4a84-a13a-9d29ba355942-kube-api-access-nsq87\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:36:19.597651 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.597570 2559 generic.go:356] "Generic (PLEG): container finished" podID="c673e230-4ab7-4a84-a13a-9d29ba355942" containerID="d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307" exitCode=0 Jul 20 20:36:19.597651 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.597620 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" Jul 20 20:36:19.597651 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.597641 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" event={"ID":"c673e230-4ab7-4a84-a13a-9d29ba355942","Type":"ContainerDied","Data":"d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307"} Jul 20 20:36:19.597882 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.597698 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf" event={"ID":"c673e230-4ab7-4a84-a13a-9d29ba355942","Type":"ContainerDied","Data":"12ba6aff1383fed3011c0181def6d974dbb6ce35c360fa736fb491dd073de232"} Jul 20 20:36:19.597882 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.597729 2559 scope.go:117] "RemoveContainer" containerID="d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307" Jul 20 20:36:19.606559 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.606542 2559 scope.go:117] "RemoveContainer" containerID="d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307" Jul 20 20:36:19.606777 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:36:19.606759 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307\": container with ID starting with d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307 not found: ID does not exist" containerID="d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307" Jul 20 20:36:19.606834 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.606786 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307"} err="failed to get container status \"d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307\": rpc error: code = NotFound desc = could not find container \"d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307\": container with ID starting with d7e4bad2030c40ae0bca8b489682b06b6689e7ea2339c7f25ac7cc72844ce307 not found: ID does not exist" Jul 20 20:36:19.621144 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.621126 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf"] Jul 20 20:36:19.625444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:19.625426 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-183471-6d556f49bb-7q4qf"] Jul 20 20:36:20.362280 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:20.362246 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c673e230-4ab7-4a84-a13a-9d29ba355942" path="/var/lib/kubelet/pods/c673e230-4ab7-4a84-a13a-9d29ba355942/volumes" Jul 20 20:36:21.530309 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:21.530280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:36:23.534700 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:23.534670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:23.917902 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:23.917873 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:30.217899 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:30.217862 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:30.317282 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:30.317246 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:30.601045 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:30.600899 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:30.801897 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:30.801872 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:31.098143 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:31.098112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:31.394965 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:31.394916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:31.947237 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:31.947201 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:34.134526 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.134486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:34.236544 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.236516 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:34.339117 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.339085 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8"] Jul 20 20:36:34.339491 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.339475 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c673e230-4ab7-4a84-a13a-9d29ba355942" containerName="maas-api" Jul 20 20:36:34.339560 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.339493 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c673e230-4ab7-4a84-a13a-9d29ba355942" containerName="maas-api" Jul 20 20:36:34.339615 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.339594 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c673e230-4ab7-4a84-a13a-9d29ba355942" containerName="maas-api" Jul 20 20:36:34.344318 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.344300 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.346495 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.346473 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 20:36:34.346693 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.346678 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-93c18a-serving-cert\"" Jul 20 20:36:34.346766 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.346746 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 20:36:34.347606 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.347589 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\"" Jul 20 20:36:34.352999 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.352975 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8"] Jul 20 20:36:34.365517 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.365480 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:34.483295 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.483230 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38512463-ec40-495e-9fce-62ab1a50282d-maas-api-tls\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.483295 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.483278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38512463-ec40-495e-9fce-62ab1a50282d-openshift-service-ca\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.483454 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.483352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxjsh\" (UniqueName: \"kubernetes.io/projected/38512463-ec40-495e-9fce-62ab1a50282d-kube-api-access-pxjsh\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.584722 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.584692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38512463-ec40-495e-9fce-62ab1a50282d-maas-api-tls\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.584851 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.584740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38512463-ec40-495e-9fce-62ab1a50282d-openshift-service-ca\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.584851 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.584770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxjsh\" (UniqueName: \"kubernetes.io/projected/38512463-ec40-495e-9fce-62ab1a50282d-kube-api-access-pxjsh\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.585467 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.585404 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38512463-ec40-495e-9fce-62ab1a50282d-openshift-service-ca\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.587255 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.587232 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38512463-ec40-495e-9fce-62ab1a50282d-maas-api-tls\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.592498 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.592481 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxjsh\" (UniqueName: \"kubernetes.io/projected/38512463-ec40-495e-9fce-62ab1a50282d-kube-api-access-pxjsh\") pod \"maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.636983 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.636952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:34.655315 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.655291 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:34.794111 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.794052 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8"] Jul 20 20:36:34.796355 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:36:34.796324 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38512463_ec40_495e_9fce_62ab1a50282d.slice/crio-a9d0100a6f98f7c9e77ff536b1998637d07e2526346d90ef87aa013c82586353 WatchSource:0}: Error finding container a9d0100a6f98f7c9e77ff536b1998637d07e2526346d90ef87aa013c82586353: Status 404 returned error can't find the container with id a9d0100a6f98f7c9e77ff536b1998637d07e2526346d90ef87aa013c82586353 Jul 20 20:36:34.963436 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:34.963406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:35.064503 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:35.064418 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:35.675670 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:35.675634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" event={"ID":"38512463-ec40-495e-9fce-62ab1a50282d","Type":"ContainerStarted","Data":"2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c"} Jul 20 20:36:35.676092 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:35.675712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" event={"ID":"38512463-ec40-495e-9fce-62ab1a50282d","Type":"ContainerStarted","Data":"a9d0100a6f98f7c9e77ff536b1998637d07e2526346d90ef87aa013c82586353"} Jul 20 20:36:35.676092 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:35.675757 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:35.693439 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:35.693397 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" podStartSLOduration=1.282864761 podStartE2EDuration="1.693384871s" totalImagesPullingTime="410.52011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:36:35.691307349 +0000 UTC m=+2403.875155080" watchObservedRunningTime="2026-07-20 20:36:35.693384871 +0000 UTC m=+2403.877232604" Jul 20 20:36:38.642783 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:38.642753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:39.133976 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.133941 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:39.388793 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.388716 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j"] Jul 20 20:36:39.392072 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.392052 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.394733 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.394711 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f9c27f-openshift-default-dockercfg-mmnpg\"" Jul 20 20:36:39.404109 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.404090 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j"] Jul 20 20:36:39.413093 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.413068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:39.528661 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.528630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-data\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.528823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.528670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ed883ec-9f05-4fae-8a16-89b23c43e327-istiod-ca-cert\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.528823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.528746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8lz4\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-kube-api-access-t8lz4\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.528823 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.528804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-certs\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.528953 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.528833 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-socket\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.528953 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.528855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-credential-socket\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.529096 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.528956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-podinfo\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.529096 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.529058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-token\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.529181 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.529112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-envoy\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629527 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-data\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629692 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ed883ec-9f05-4fae-8a16-89b23c43e327-istiod-ca-cert\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629692 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8lz4\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-kube-api-access-t8lz4\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629692 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-certs\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629692 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-socket\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629908 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-credential-socket\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629908 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-podinfo\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629908 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-token\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.629908 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-envoy\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.630136 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.629914 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-data\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.630136 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.630002 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-certs\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.630136 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.630080 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-socket\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.630285 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.630165 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-credential-socket\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.630320 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.630311 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ed883ec-9f05-4fae-8a16-89b23c43e327-istiod-ca-cert\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.632170 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.632143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-envoy\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.632322 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.632306 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-podinfo\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.637591 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.637565 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-token\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.637697 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.637599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8lz4\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-kube-api-access-t8lz4\") pod \"e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.703089 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.703035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:39.838299 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.838243 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j"] Jul 20 20:36:39.840416 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:36:39.840384 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed883ec_9f05_4fae_8a16_89b23c43e327.slice/crio-409b4e8ae0037792d175e02a933dce6718040fdd34aa9a1a6c30bf8cc7d5c778 WatchSource:0}: Error finding container 409b4e8ae0037792d175e02a933dce6718040fdd34aa9a1a6c30bf8cc7d5c778: Status 404 returned error can't find the container with id 409b4e8ae0037792d175e02a933dce6718040fdd34aa9a1a6c30bf8cc7d5c778 Jul 20 20:36:39.842688 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.842649 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:36:39.842763 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.842740 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:36:39.842806 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.842785 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:36:39.991562 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:39.991486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:40.700215 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:40.700172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" event={"ID":"7ed883ec-9f05-4fae-8a16-89b23c43e327","Type":"ContainerStarted","Data":"2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8"} Jul 20 20:36:40.700379 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:40.700256 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" event={"ID":"7ed883ec-9f05-4fae-8a16-89b23c43e327","Type":"ContainerStarted","Data":"409b4e8ae0037792d175e02a933dce6718040fdd34aa9a1a6c30bf8cc7d5c778"} Jul 20 20:36:40.703443 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:40.703425 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:40.707763 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:40.707741 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:40.720683 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:40.720641 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" podStartSLOduration=1.720627888 podStartE2EDuration="1.720627888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:36:40.718624106 +0000 UTC m=+2408.902471851" watchObservedRunningTime="2026-07-20 20:36:40.720627888 +0000 UTC m=+2408.904475674" Jul 20 20:36:41.027348 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:41.027274 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:36:41.685608 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:41.685570 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:36:41.706073 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:41.706048 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:41.707081 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:41.707058 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:42.691770 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.691737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:42.782399 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.782354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:42.787313 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.787287 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6"] Jul 20 20:36:42.790957 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.790939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.794931 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.794911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f9c27f-serving-cert\"" Jul 20 20:36:42.801688 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.801670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6"] Jul 20 20:36:42.858325 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.858293 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:42.861395 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.861376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ebefc6-c220-45e4-af10-440459961c7c-openshift-service-ca\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.861458 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.861411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ebefc6-c220-45e4-af10-440459961c7c-maas-api-tls\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.861499 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.861480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltxdq\" (UniqueName: \"kubernetes.io/projected/40ebefc6-c220-45e4-af10-440459961c7c-kube-api-access-ltxdq\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.962156 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.962083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxdq\" (UniqueName: \"kubernetes.io/projected/40ebefc6-c220-45e4-af10-440459961c7c-kube-api-access-ltxdq\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.962297 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.962176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ebefc6-c220-45e4-af10-440459961c7c-openshift-service-ca\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.962297 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.962205 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ebefc6-c220-45e4-af10-440459961c7c-maas-api-tls\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.962877 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.962859 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ebefc6-c220-45e4-af10-440459961c7c-openshift-service-ca\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.964695 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.964675 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ebefc6-c220-45e4-af10-440459961c7c-maas-api-tls\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:42.972465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.972426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:42.972930 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:42.972909 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltxdq\" (UniqueName: \"kubernetes.io/projected/40ebefc6-c220-45e4-af10-440459961c7c-kube-api-access-ltxdq\") pod \"maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:43.102454 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.102434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:43.232375 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.232349 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6"] Jul 20 20:36:43.234082 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:36:43.234057 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ebefc6_c220_45e4_af10_440459961c7c.slice/crio-fdfdcc7ee456a4a2c067d27d8a177e7aa8af481b81c264a1cc36761005d6b0dc WatchSource:0}: Error finding container fdfdcc7ee456a4a2c067d27d8a177e7aa8af481b81c264a1cc36761005d6b0dc: Status 404 returned error can't find the container with id fdfdcc7ee456a4a2c067d27d8a177e7aa8af481b81c264a1cc36761005d6b0dc Jul 20 20:36:43.486965 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.486874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:43.660769 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.660734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:43.717632 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.717600 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" event={"ID":"40ebefc6-c220-45e4-af10-440459961c7c","Type":"ContainerStarted","Data":"792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523"} Jul 20 20:36:43.717766 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.717692 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" event={"ID":"40ebefc6-c220-45e4-af10-440459961c7c","Type":"ContainerStarted","Data":"fdfdcc7ee456a4a2c067d27d8a177e7aa8af481b81c264a1cc36761005d6b0dc"} Jul 20 20:36:43.717766 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.717730 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:43.734508 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:43.734462 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" podStartSLOduration=1.354987182 podStartE2EDuration="1.734449851s" totalImagesPullingTime="379.462669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:36:43.732969899 +0000 UTC m=+2411.916817631" watchObservedRunningTime="2026-07-20 20:36:43.734449851 +0000 UTC m=+2411.918297583" Jul 20 20:36:47.172047 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:47.171991 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:49.733439 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:49.733411 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:36:54.426618 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:54.426539 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:36:55.775483 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:55.775454 2559 generic.go:356] "Generic (PLEG): container finished" podID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerID="2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8" exitCode=0 Jul 20 20:36:55.775863 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:55.775530 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" event={"ID":"7ed883ec-9f05-4fae-8a16-89b23c43e327","Type":"ContainerDied","Data":"2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8"} Jul 20 20:36:55.775913 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:55.775896 2559 scope.go:117] "RemoveContainer" containerID="2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8" Jul 20 20:36:55.776924 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:55.776893 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:36:55.777050 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:55.776977 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:36:55.777050 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:55.777040 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:36:56.018256 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:56.018225 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:56.118831 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:56.118727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:56.612957 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:56.612921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:56.706942 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:56.706913 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:56.781845 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:56.781809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" event={"ID":"7ed883ec-9f05-4fae-8a16-89b23c43e327","Type":"ContainerStarted","Data":"aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a"} Jul 20 20:36:57.703522 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:57.703474 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:36:57.704575 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:57.704550 2559 patch_prober.go:28] interesting pod/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 20 20:36:57.704675 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:57.704603 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 20 20:36:58.433819 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:58.433758 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:58.492302 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:58.492270 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:36:58.704374 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:58.704301 2559 patch_prober.go:28] interesting pod/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 20 20:36:58.704374 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:58.704366 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 20 20:36:59.703369 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:59.703339 2559 patch_prober.go:28] interesting pod/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 20 20:36:59.703732 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:36:59.703390 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 20 20:37:00.707344 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:00.707313 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:37:00.707776 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:00.707681 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:37:00.708357 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:00.708336 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:37:04.272327 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:04.272295 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:04.384894 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:04.384861 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:06.078741 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:06.078699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:06.179380 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:06.179343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:11.316545 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.316512 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8"] Jul 20 20:37:11.316955 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.316729 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" podUID="38512463-ec40-495e-9fce-62ab1a50282d" containerName="maas-api" containerID="cri-o://2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c" gracePeriod=30 Jul 20 20:37:11.352351 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.352328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:11.568055 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.567988 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:37:11.632610 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.632578 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38512463-ec40-495e-9fce-62ab1a50282d-maas-api-tls\") pod \"38512463-ec40-495e-9fce-62ab1a50282d\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " Jul 20 20:37:11.632732 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.632633 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38512463-ec40-495e-9fce-62ab1a50282d-openshift-service-ca\") pod \"38512463-ec40-495e-9fce-62ab1a50282d\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " Jul 20 20:37:11.632732 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.632693 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxjsh\" (UniqueName: \"kubernetes.io/projected/38512463-ec40-495e-9fce-62ab1a50282d-kube-api-access-pxjsh\") pod \"38512463-ec40-495e-9fce-62ab1a50282d\" (UID: \"38512463-ec40-495e-9fce-62ab1a50282d\") " Jul 20 20:37:11.633010 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.632986 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38512463-ec40-495e-9fce-62ab1a50282d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38512463-ec40-495e-9fce-62ab1a50282d" (UID: "38512463-ec40-495e-9fce-62ab1a50282d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:37:11.634662 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.634639 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38512463-ec40-495e-9fce-62ab1a50282d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38512463-ec40-495e-9fce-62ab1a50282d" (UID: "38512463-ec40-495e-9fce-62ab1a50282d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:37:11.634772 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.634751 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38512463-ec40-495e-9fce-62ab1a50282d-kube-api-access-pxjsh" (OuterVolumeSpecName: "kube-api-access-pxjsh") pod "38512463-ec40-495e-9fce-62ab1a50282d" (UID: "38512463-ec40-495e-9fce-62ab1a50282d"). InnerVolumeSpecName "kube-api-access-pxjsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:37:11.733381 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.733353 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38512463-ec40-495e-9fce-62ab1a50282d-openshift-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:11.733381 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.733378 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxjsh\" (UniqueName: \"kubernetes.io/projected/38512463-ec40-495e-9fce-62ab1a50282d-kube-api-access-pxjsh\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:11.733503 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.733392 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38512463-ec40-495e-9fce-62ab1a50282d-maas-api-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:11.854752 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.854697 2559 generic.go:356] "Generic (PLEG): container finished" podID="38512463-ec40-495e-9fce-62ab1a50282d" containerID="2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c" exitCode=0 Jul 20 20:37:11.854752 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.854738 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" Jul 20 20:37:11.854898 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.854788 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" event={"ID":"38512463-ec40-495e-9fce-62ab1a50282d","Type":"ContainerDied","Data":"2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c"} Jul 20 20:37:11.854898 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.854844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8" event={"ID":"38512463-ec40-495e-9fce-62ab1a50282d","Type":"ContainerDied","Data":"a9d0100a6f98f7c9e77ff536b1998637d07e2526346d90ef87aa013c82586353"} Jul 20 20:37:11.854898 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.854877 2559 scope.go:117] "RemoveContainer" containerID="2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c" Jul 20 20:37:11.863936 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.863921 2559 scope.go:117] "RemoveContainer" containerID="2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c" Jul 20 20:37:11.864203 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:37:11.864186 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c\": container with ID starting with 2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c not found: ID does not exist" containerID="2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c" Jul 20 20:37:11.864257 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.864211 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c"} err="failed to get container status \"2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c\": rpc error: code = NotFound desc = could not find container \"2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c\": container with ID starting with 2f2aab1159ee0d46685f44c550c372ee1fc81d9d4a09085e0b29cb5f6328792c not found: ID does not exist" Jul 20 20:37:11.874727 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.874706 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8"] Jul 20 20:37:11.878579 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:11.878560 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-93c18a-845668bcd9-cc4b8"] Jul 20 20:37:12.362404 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:12.362357 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38512463-ec40-495e-9fce-62ab1a50282d" path="/var/lib/kubelet/pods/38512463-ec40-495e-9fce-62ab1a50282d/volumes" Jul 20 20:37:13.051353 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:13.051322 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:13.158227 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:13.158200 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:14.422561 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:14.422530 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:37:15.439878 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:15.439845 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:15.829524 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:15.829449 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:22.192108 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:22.192077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:22.292940 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:22.292903 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:22.470136 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:22.470061 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:23.156446 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:23.156411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:23.609355 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:23.609276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:23.712515 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:23.712472 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:38.389217 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.389182 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6"] Jul 20 20:37:38.389893 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.389837 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" podUID="40ebefc6-c220-45e4-af10-440459961c7c" containerName="maas-api" containerID="cri-o://792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523" gracePeriod=30 Jul 20 20:37:38.440261 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.440231 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:38.644105 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.644048 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:37:38.656559 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.656539 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ebefc6-c220-45e4-af10-440459961c7c-maas-api-tls\") pod \"40ebefc6-c220-45e4-af10-440459961c7c\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " Jul 20 20:37:38.656636 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.656565 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltxdq\" (UniqueName: \"kubernetes.io/projected/40ebefc6-c220-45e4-af10-440459961c7c-kube-api-access-ltxdq\") pod \"40ebefc6-c220-45e4-af10-440459961c7c\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " Jul 20 20:37:38.656723 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.656703 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ebefc6-c220-45e4-af10-440459961c7c-openshift-service-ca\") pod \"40ebefc6-c220-45e4-af10-440459961c7c\" (UID: \"40ebefc6-c220-45e4-af10-440459961c7c\") " Jul 20 20:37:38.657027 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.656988 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ebefc6-c220-45e4-af10-440459961c7c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40ebefc6-c220-45e4-af10-440459961c7c" (UID: "40ebefc6-c220-45e4-af10-440459961c7c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:37:38.658555 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.658536 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ebefc6-c220-45e4-af10-440459961c7c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40ebefc6-c220-45e4-af10-440459961c7c" (UID: "40ebefc6-c220-45e4-af10-440459961c7c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:37:38.658689 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.658669 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ebefc6-c220-45e4-af10-440459961c7c-kube-api-access-ltxdq" (OuterVolumeSpecName: "kube-api-access-ltxdq") pod "40ebefc6-c220-45e4-af10-440459961c7c" (UID: "40ebefc6-c220-45e4-af10-440459961c7c"). InnerVolumeSpecName "kube-api-access-ltxdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:37:38.758262 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.758238 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ebefc6-c220-45e4-af10-440459961c7c-openshift-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:38.758262 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.758260 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ebefc6-c220-45e4-af10-440459961c7c-maas-api-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:38.758418 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.758269 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltxdq\" (UniqueName: \"kubernetes.io/projected/40ebefc6-c220-45e4-af10-440459961c7c-kube-api-access-ltxdq\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:38.981633 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.981560 2559 generic.go:356] "Generic (PLEG): container finished" podID="40ebefc6-c220-45e4-af10-440459961c7c" containerID="792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523" exitCode=0 Jul 20 20:37:38.981633 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.981601 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" Jul 20 20:37:38.981633 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.981621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" event={"ID":"40ebefc6-c220-45e4-af10-440459961c7c","Type":"ContainerDied","Data":"792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523"} Jul 20 20:37:38.981814 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.981670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6" event={"ID":"40ebefc6-c220-45e4-af10-440459961c7c","Type":"ContainerDied","Data":"fdfdcc7ee456a4a2c067d27d8a177e7aa8af481b81c264a1cc36761005d6b0dc"} Jul 20 20:37:38.981814 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.981692 2559 scope.go:117] "RemoveContainer" containerID="792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523" Jul 20 20:37:38.995521 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.995500 2559 scope.go:117] "RemoveContainer" containerID="792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523" Jul 20 20:37:38.995752 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:37:38.995730 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523\": container with ID starting with 792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523 not found: ID does not exist" containerID="792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523" Jul 20 20:37:38.995815 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:38.995763 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523"} err="failed to get container status \"792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523\": rpc error: code = NotFound desc = could not find container \"792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523\": container with ID starting with 792c0f2b2515d6b271ed76ffb4d30a65c0f745eaa91f73cab12ae32b7ce12523 not found: ID does not exist" Jul 20 20:37:39.007212 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:39.007190 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6"] Jul 20 20:37:39.016293 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:39.016275 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c27f-6b97488dd4-r7zw6"] Jul 20 20:37:40.362630 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:40.362592 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ebefc6-c220-45e4-af10-440459961c7c" path="/var/lib/kubelet/pods/40ebefc6-c220-45e4-af10-440459961c7c/volumes" Jul 20 20:37:42.893940 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:42.893909 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:43.030891 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:43.030851 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:37:43.287106 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:43.286999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:49.330177 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:49.330140 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:49.406135 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:49.406097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:49.596948 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:49.596869 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j"] Jul 20 20:37:49.597150 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:49.597123 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" containerID="cri-o://aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a" gracePeriod=30 Jul 20 20:37:49.614752 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:49.614727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:49.846076 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:49.846043 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:50.237659 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:50.237619 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:50.519277 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:50.519192 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:50.647974 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:50.647938 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:53.669426 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.669385 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l"] Jul 20 20:37:53.669987 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.669970 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ebefc6-c220-45e4-af10-440459961c7c" containerName="maas-api" Jul 20 20:37:53.670103 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.669990 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ebefc6-c220-45e4-af10-440459961c7c" containerName="maas-api" Jul 20 20:37:53.670103 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.670029 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38512463-ec40-495e-9fce-62ab1a50282d" containerName="maas-api" Jul 20 20:37:53.670103 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.670038 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="38512463-ec40-495e-9fce-62ab1a50282d" containerName="maas-api" Jul 20 20:37:53.670253 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.670132 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ebefc6-c220-45e4-af10-440459961c7c" containerName="maas-api" Jul 20 20:37:53.670253 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.670148 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="38512463-ec40-495e-9fce-62ab1a50282d" containerName="maas-api" Jul 20 20:37:53.675120 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.675095 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.677611 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.677586 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 20 20:37:53.678198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.678173 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b15c6d-serving-cert\"" Jul 20 20:37:53.678198 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.678190 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sf77l\"" Jul 20 20:37:53.678366 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.678196 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 20 20:37:53.688697 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.688665 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l"] Jul 20 20:37:53.790413 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.790362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6hw6\" (UniqueName: \"kubernetes.io/projected/352879a8-bb94-4ab9-b444-e46156a04ea8-kube-api-access-r6hw6\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.790655 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.790491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.790655 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.790541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352879a8-bb94-4ab9-b444-e46156a04ea8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.815829 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.815798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:53.892101 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.892068 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.892247 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.892115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352879a8-bb94-4ab9-b444-e46156a04ea8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.892247 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.892202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6hw6\" (UniqueName: \"kubernetes.io/projected/352879a8-bb94-4ab9-b444-e46156a04ea8-kube-api-access-r6hw6\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.892247 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:37:53.892216 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-serving-cert: secret "maas-api-e2e-shared-a-b15c6d-serving-cert" not found Jul 20 20:37:53.892371 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:37:53.892296 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls podName:352879a8-bb94-4ab9-b444-e46156a04ea8 nodeName:}" failed. No retries permitted until 2026-07-20 20:37:54.392276058 +0000 UTC m=+2482.576123793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls") pod "maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" (UID: "352879a8-bb94-4ab9-b444-e46156a04ea8") : secret "maas-api-e2e-shared-a-b15c6d-serving-cert" not found Jul 20 20:37:53.892780 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.892763 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352879a8-bb94-4ab9-b444-e46156a04ea8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.904577 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.904555 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6hw6\" (UniqueName: \"kubernetes.io/projected/352879a8-bb94-4ab9-b444-e46156a04ea8-kube-api-access-r6hw6\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:53.931877 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:53.931811 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:54.181388 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.181346 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:54.397848 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.397815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:54.400305 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.400282 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls\") pod \"maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:54.477055 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.477002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:54.586517 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.586486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:54.713637 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.713617 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l"] Jul 20 20:37:54.715892 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:37:54.715864 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352879a8_bb94_4ab9_b444_e46156a04ea8.slice/crio-181e735d0e99a6c5811efe698293996b494ad4d0db44aedf9af9b4d9407da67c WatchSource:0}: Error finding container 181e735d0e99a6c5811efe698293996b494ad4d0db44aedf9af9b4d9407da67c: Status 404 returned error can't find the container with id 181e735d0e99a6c5811efe698293996b494ad4d0db44aedf9af9b4d9407da67c Jul 20 20:37:54.829236 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.829215 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:37:54.876958 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.876926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:54.903322 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903303 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8lz4\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-kube-api-access-t8lz4\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903348 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ed883ec-9f05-4fae-8a16-89b23c43e327-istiod-ca-cert\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903379 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-credential-socket\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903399 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-socket\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903419 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-podinfo\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903636 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903460 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-certs\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903636 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903509 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-envoy\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903636 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903592 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-data\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903636 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903617 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-token\") pod \"7ed883ec-9f05-4fae-8a16-89b23c43e327\" (UID: \"7ed883ec-9f05-4fae-8a16-89b23c43e327\") " Jul 20 20:37:54.903837 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903677 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:37:54.903837 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903690 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:37:54.903962 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903937 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-credential-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:54.904049 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903960 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:54.904049 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.903984 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ed883ec-9f05-4fae-8a16-89b23c43e327-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:37:54.904158 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.904117 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:37:54.905040 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.904991 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:37:54.905628 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.905605 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-kube-api-access-t8lz4" (OuterVolumeSpecName: "kube-api-access-t8lz4") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "kube-api-access-t8lz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:37:54.906119 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.906097 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:37:54.906266 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.906248 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:37:54.906322 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:54.906245 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ed883ec-9f05-4fae-8a16-89b23c43e327" (UID: "7ed883ec-9f05-4fae-8a16-89b23c43e327"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:37:55.005372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.005320 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8lz4\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-kube-api-access-t8lz4\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:55.005372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.005340 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ed883ec-9f05-4fae-8a16-89b23c43e327-istiod-ca-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:55.005372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.005351 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-podinfo\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:55.005372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.005358 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-workload-certs\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:55.005372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.005366 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-envoy\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:55.005372 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.005373 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-data\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:55.005603 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.005380 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ed883ec-9f05-4fae-8a16-89b23c43e327-istio-token\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:37:55.061676 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.061649 2559 generic.go:356] "Generic (PLEG): container finished" podID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerID="aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a" exitCode=0 Jul 20 20:37:55.061766 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.061700 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" Jul 20 20:37:55.061766 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.061711 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" event={"ID":"7ed883ec-9f05-4fae-8a16-89b23c43e327","Type":"ContainerDied","Data":"aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a"} Jul 20 20:37:55.061766 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.061759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j" event={"ID":"7ed883ec-9f05-4fae-8a16-89b23c43e327","Type":"ContainerDied","Data":"409b4e8ae0037792d175e02a933dce6718040fdd34aa9a1a6c30bf8cc7d5c778"} Jul 20 20:37:55.061924 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.061782 2559 scope.go:117] "RemoveContainer" containerID="aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a" Jul 20 20:37:55.063068 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.063048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" event={"ID":"352879a8-bb94-4ab9-b444-e46156a04ea8","Type":"ContainerStarted","Data":"181e735d0e99a6c5811efe698293996b494ad4d0db44aedf9af9b4d9407da67c"} Jul 20 20:37:55.070829 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.070811 2559 scope.go:117] "RemoveContainer" containerID="2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8" Jul 20 20:37:55.078442 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.078418 2559 scope.go:117] "RemoveContainer" containerID="aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a" Jul 20 20:37:55.078713 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:37:55.078696 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a\": container with ID starting with aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a not found: ID does not exist" containerID="aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a" Jul 20 20:37:55.078780 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.078721 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a"} err="failed to get container status \"aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a\": rpc error: code = NotFound desc = could not find container \"aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a\": container with ID starting with aab48266253c79bcc39fe357eda58b7bc24c8e4c67731767bb96d1aa9d82c06a not found: ID does not exist" Jul 20 20:37:55.078780 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.078738 2559 scope.go:117] "RemoveContainer" containerID="2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8" Jul 20 20:37:55.079129 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:37:55.079107 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8\": container with ID starting with 2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8 not found: ID does not exist" containerID="2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8" Jul 20 20:37:55.079186 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.079141 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8"} err="failed to get container status \"2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8\": rpc error: code = NotFound desc = could not find container \"2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8\": container with ID starting with 2d27a2bfe9b4f2e63f0254addd86da6e34990601435a345725f68820889ed8e8 not found: ID does not exist" Jul 20 20:37:55.083379 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.083357 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j"] Jul 20 20:37:55.090565 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:55.090542 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f9c27f-openshift-default-568bdc664c-vgq8j"] Jul 20 20:37:56.069129 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:56.069087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" event={"ID":"352879a8-bb94-4ab9-b444-e46156a04ea8","Type":"ContainerStarted","Data":"578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a"} Jul 20 20:37:56.069567 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:56.069276 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:37:56.096601 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:56.096548 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" podStartSLOduration=1.962257665 podStartE2EDuration="3.096529942s" totalImagesPullingTime="1.134272277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:37:56.096349974 +0000 UTC m=+2484.280197707" watchObservedRunningTime="2026-07-20 20:37:56.096529942 +0000 UTC m=+2484.280377674" Jul 20 20:37:56.363316 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:56.363280 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" path="/var/lib/kubelet/pods/7ed883ec-9f05-4fae-8a16-89b23c43e327/volumes" Jul 20 20:37:58.042462 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.042427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:58.373740 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.373638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:58.668943 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.668918 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd"] Jul 20 20:37:58.669323 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.669308 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" Jul 20 20:37:58.669323 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.669324 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" Jul 20 20:37:58.669444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.669350 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" Jul 20 20:37:58.669444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.669360 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" Jul 20 20:37:58.669444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.669419 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" Jul 20 20:37:58.672480 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.672462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.675212 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.675191 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-40065f-openshift-default-dockercfg-nqmtw\"" Jul 20 20:37:58.686113 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.686091 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd"] Jul 20 20:37:58.701427 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.701379 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:58.738210 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-podinfo\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738315 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-token\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738315 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-socket\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738315 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-certs\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738315 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c2237e-3a67-4186-b5ce-fc9228aa8268-istiod-ca-cert\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738315 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhvrj\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-kube-api-access-qhvrj\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738491 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-credential-socket\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738491 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-data\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.738491 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.738443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-envoy\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.839599 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-podinfo\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.839778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-token\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.839778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-socket\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.839778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-certs\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.839778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c2237e-3a67-4186-b5ce-fc9228aa8268-istiod-ca-cert\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.839778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhvrj\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-kube-api-access-qhvrj\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.839778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-credential-socket\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.840110 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-data\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.840110 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.839871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-envoy\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.840479 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.840398 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-socket\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.840582 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.840511 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-credential-socket\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.840582 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.840540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-certs\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.840703 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.840634 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-data\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.840819 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.840795 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c2237e-3a67-4186-b5ce-fc9228aa8268-istiod-ca-cert\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.842347 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.842323 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-envoy\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.842813 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.842790 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-podinfo\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.862383 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.862358 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhvrj\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-kube-api-access-qhvrj\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.863608 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.863589 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-token\") pod \"e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:58.938260 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.938188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:37:58.982500 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:58.982478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:37:59.117558 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:59.117536 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd"] Jul 20 20:37:59.119684 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:37:59.119658 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c2237e_3a67_4186_b5ce_fc9228aa8268.slice/crio-15b26310a6c04bf3185dd0ca3f45f756be9761e387e1a11d91f1efd25c0bd5fb WatchSource:0}: Error finding container 15b26310a6c04bf3185dd0ca3f45f756be9761e387e1a11d91f1efd25c0bd5fb: Status 404 returned error can't find the container with id 15b26310a6c04bf3185dd0ca3f45f756be9761e387e1a11d91f1efd25c0bd5fb Jul 20 20:37:59.121860 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:59.121829 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:37:59.121951 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:59.121891 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:37:59.121951 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:37:59.121917 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:38:00.090551 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:00.090516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" event={"ID":"55c2237e-3a67-4186-b5ce-fc9228aa8268","Type":"ContainerStarted","Data":"5384ec265e069820dfb70fab2983261e954ffe0e40f279ee08d325f79fd21d19"} Jul 20 20:38:00.090717 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:00.090567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" event={"ID":"55c2237e-3a67-4186-b5ce-fc9228aa8268","Type":"ContainerStarted","Data":"15b26310a6c04bf3185dd0ca3f45f756be9761e387e1a11d91f1efd25c0bd5fb"} Jul 20 20:38:00.109780 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:00.109726 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" podStartSLOduration=2.109711552 podStartE2EDuration="2.109711552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:37:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:38:00.108206645 +0000 UTC m=+2488.292054378" watchObservedRunningTime="2026-07-20 20:38:00.109711552 +0000 UTC m=+2488.293559283" Jul 20 20:38:00.982696 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:00.982664 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:00.986729 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:00.986707 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:01.095299 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:01.095267 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:01.096130 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:01.096108 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:01.530538 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:01.530507 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:38:02.082202 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.082172 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:38:02.126970 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.126939 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57"] Jul 20 20:38:02.129768 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.129742 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ed883ec-9f05-4fae-8a16-89b23c43e327" containerName="istio-proxy" Jul 20 20:38:02.133881 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.133858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.137393 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.137362 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-40065f-serving-cert\"" Jul 20 20:38:02.145223 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.145198 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57"] Jul 20 20:38:02.275120 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.275086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bjnj\" (UniqueName: \"kubernetes.io/projected/f360363e-2623-4a83-88a2-02fd6d299910-kube-api-access-9bjnj\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.275288 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.275146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.275288 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.275245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f360363e-2623-4a83-88a2-02fd6d299910-openshift-service-ca\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.291329 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.291300 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:02.376092 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.376000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bjnj\" (UniqueName: \"kubernetes.io/projected/f360363e-2623-4a83-88a2-02fd6d299910-kube-api-access-9bjnj\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.376210 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.376104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.376210 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.376161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f360363e-2623-4a83-88a2-02fd6d299910-openshift-service-ca\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.376303 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:38:02.376235 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-serving-cert: secret "maas-api-e2e-shared-b-40065f-serving-cert" not found Jul 20 20:38:02.376303 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:38:02.376288 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls podName:f360363e-2623-4a83-88a2-02fd6d299910 nodeName:}" failed. No retries permitted until 2026-07-20 20:38:02.876273866 +0000 UTC m=+2491.060121576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls") pod "maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" (UID: "f360363e-2623-4a83-88a2-02fd6d299910") : secret "maas-api-e2e-shared-b-40065f-serving-cert" not found Jul 20 20:38:02.376746 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.376728 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f360363e-2623-4a83-88a2-02fd6d299910-openshift-service-ca\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.390782 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.390766 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bjnj\" (UniqueName: \"kubernetes.io/projected/f360363e-2623-4a83-88a2-02fd6d299910-kube-api-access-9bjnj\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.404396 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.404363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:02.598778 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.598747 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:02.798071 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.798003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:02.880074 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.880045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:02.882532 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:02.882506 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls\") pod \"maas-api-e2e-shared-b-40065f-6bf98777cc-57k57\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:03.047431 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:03.047397 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:03.180884 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:03.180861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57"] Jul 20 20:38:03.182965 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:38:03.182941 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf360363e_2623_4a83_88a2_02fd6d299910.slice/crio-8806763ce672b7f9eae4c67b0832be5436cda5fc90709b9bfc807f6694efbe37 WatchSource:0}: Error finding container 8806763ce672b7f9eae4c67b0832be5436cda5fc90709b9bfc807f6694efbe37: Status 404 returned error can't find the container with id 8806763ce672b7f9eae4c67b0832be5436cda5fc90709b9bfc807f6694efbe37 Jul 20 20:38:03.642685 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:03.642648 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:04.112848 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:04.112814 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" event={"ID":"f360363e-2623-4a83-88a2-02fd6d299910","Type":"ContainerStarted","Data":"328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645"} Jul 20 20:38:04.113073 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:04.112872 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" event={"ID":"f360363e-2623-4a83-88a2-02fd6d299910","Type":"ContainerStarted","Data":"8806763ce672b7f9eae4c67b0832be5436cda5fc90709b9bfc807f6694efbe37"} Jul 20 20:38:04.113073 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:04.112947 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:04.132663 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:04.132600 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" podStartSLOduration=1.827243331 podStartE2EDuration="2.13258654s" totalImagesPullingTime="305.343209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:38:04.13087682 +0000 UTC m=+2492.314724552" watchObservedRunningTime="2026-07-20 20:38:04.13258654 +0000 UTC m=+2492.316434272" Jul 20 20:38:06.561225 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:06.561196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:10.131285 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:10.131248 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:38:12.235822 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:12.235781 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:38:15.133805 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:15.133769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:15.234097 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:15.234066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:16.096740 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.096710 2559 patch_prober.go:28] interesting pod/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 20 20:38:16.096909 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.096777 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 20 20:38:16.176080 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.176058 2559 generic.go:356] "Generic (PLEG): container finished" podID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerID="5384ec265e069820dfb70fab2983261e954ffe0e40f279ee08d325f79fd21d19" exitCode=0 Jul 20 20:38:16.176403 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.176131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" event={"ID":"55c2237e-3a67-4186-b5ce-fc9228aa8268","Type":"ContainerDied","Data":"5384ec265e069820dfb70fab2983261e954ffe0e40f279ee08d325f79fd21d19"} Jul 20 20:38:16.176516 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.176502 2559 scope.go:117] "RemoveContainer" containerID="5384ec265e069820dfb70fab2983261e954ffe0e40f279ee08d325f79fd21d19" Jul 20 20:38:16.177486 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.177461 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:38:16.177588 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.177523 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:38:16.177588 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:16.177555 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 20 20:38:17.183310 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:17.183274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" event={"ID":"55c2237e-3a67-4186-b5ce-fc9228aa8268","Type":"ContainerStarted","Data":"4d6b2270c88229470740bc111d90ba1e04d36a05ba1f2b17bd2daece18dad31b"} Jul 20 20:38:17.982943 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:17.982903 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:17.983196 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:17.983168 2559 patch_prober.go:28] interesting pod/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 20 20:38:17.983249 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:17.983227 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 20 20:38:18.982994 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:18.982947 2559 patch_prober.go:28] interesting pod/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 20 20:38:18.983440 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:18.983060 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 20 20:38:19.983457 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:19.983423 2559 patch_prober.go:28] interesting pod/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 20 20:38:19.983836 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:19.983479 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 20 20:38:20.987170 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:20.987137 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:20.987545 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:20.987498 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:20.987999 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:20.987979 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:38:23.664785 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:23.664671 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:23.765357 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:23.765323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:40.845236 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:40.845204 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:43.881123 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:43.881074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:38:46.823266 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:38:46.823232 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:39:03.954176 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:39:03.954136 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:39:07.127296 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:39:07.127259 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:39:25.929574 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:39:25.929536 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:39:42.942743 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:39:42.942708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:40:02.232338 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:40:02.232259 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:40:04.056437 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:40:04.056397 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:40:04.992148 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:40:04.992115 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:40:16.736075 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:40:16.736044 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:40:33.036706 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:40:33.036670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:40:53.131293 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:40:53.131259 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:41:11.231191 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:11.231156 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:41:23.273765 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:23.273679 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:41:24.980393 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:24.980354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:41:27.710649 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:27.710595 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:41:27.769505 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:27.769481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:41:29.925392 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:29.925358 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:41:42.369124 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:42.369080 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:41:45.321411 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:41:45.321377 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:42:08.481246 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:08.481207 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:42:12.234760 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:12.234724 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:42:13.889150 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:13.889120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:42:13.990155 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:13.990123 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:42:26.526689 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:26.526650 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:42:44.433839 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:44.433806 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:42:46.160266 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:46.160232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:42:48.134454 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:42:48.134423 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:43:01.631572 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:01.631465 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:43:07.078076 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:07.078038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:43:09.332913 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:09.332879 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:43:16.206336 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:16.206289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:43:16.266195 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:16.266141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:43:24.393898 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:24.393830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:43:24.495072 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:24.495042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:43:37.916485 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:37.916443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:43:41.630444 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:43:41.630408 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:44:05.825298 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:05.825261 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:44:20.333212 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:20.333173 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:44:27.586747 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:27.586643 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:44:28.463454 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:28.463415 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:44:40.530411 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:40.530374 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:44:48.354181 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:48.354150 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:44:48.686289 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:48.686255 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:44:57.991293 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:57.991262 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l"] Jul 20 20:44:57.991743 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:57.991535 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" podUID="352879a8-bb94-4ab9-b444-e46156a04ea8" containerName="maas-api" containerID="cri-o://578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a" gracePeriod=30 Jul 20 20:44:58.015090 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.015050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:44:58.247274 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.247217 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:44:58.382030 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.381989 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls\") pod \"352879a8-bb94-4ab9-b444-e46156a04ea8\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " Jul 20 20:44:58.382163 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.382059 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6hw6\" (UniqueName: \"kubernetes.io/projected/352879a8-bb94-4ab9-b444-e46156a04ea8-kube-api-access-r6hw6\") pod \"352879a8-bb94-4ab9-b444-e46156a04ea8\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " Jul 20 20:44:58.382163 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.382118 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352879a8-bb94-4ab9-b444-e46156a04ea8-openshift-service-ca\") pod \"352879a8-bb94-4ab9-b444-e46156a04ea8\" (UID: \"352879a8-bb94-4ab9-b444-e46156a04ea8\") " Jul 20 20:44:58.382514 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.382477 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/352879a8-bb94-4ab9-b444-e46156a04ea8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "352879a8-bb94-4ab9-b444-e46156a04ea8" (UID: "352879a8-bb94-4ab9-b444-e46156a04ea8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:44:58.384169 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.384146 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "352879a8-bb94-4ab9-b444-e46156a04ea8" (UID: "352879a8-bb94-4ab9-b444-e46156a04ea8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:44:58.384256 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.384228 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/352879a8-bb94-4ab9-b444-e46156a04ea8-kube-api-access-r6hw6" (OuterVolumeSpecName: "kube-api-access-r6hw6") pod "352879a8-bb94-4ab9-b444-e46156a04ea8" (UID: "352879a8-bb94-4ab9-b444-e46156a04ea8"). InnerVolumeSpecName "kube-api-access-r6hw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:44:58.483093 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.483070 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6hw6\" (UniqueName: \"kubernetes.io/projected/352879a8-bb94-4ab9-b444-e46156a04ea8-kube-api-access-r6hw6\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:44:58.483093 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.483092 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/352879a8-bb94-4ab9-b444-e46156a04ea8-openshift-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:44:58.483223 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:58.483101 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/352879a8-bb94-4ab9-b444-e46156a04ea8-maas-api-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:44:59.078840 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.078811 2559 generic.go:356] "Generic (PLEG): container finished" podID="352879a8-bb94-4ab9-b444-e46156a04ea8" containerID="578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a" exitCode=0 Jul 20 20:44:59.079217 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.078854 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" Jul 20 20:44:59.079217 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.078897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" event={"ID":"352879a8-bb94-4ab9-b444-e46156a04ea8","Type":"ContainerDied","Data":"578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a"} Jul 20 20:44:59.079217 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.078950 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l" event={"ID":"352879a8-bb94-4ab9-b444-e46156a04ea8","Type":"ContainerDied","Data":"181e735d0e99a6c5811efe698293996b494ad4d0db44aedf9af9b4d9407da67c"} Jul 20 20:44:59.079217 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.078971 2559 scope.go:117] "RemoveContainer" containerID="578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a" Jul 20 20:44:59.087894 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.087879 2559 scope.go:117] "RemoveContainer" containerID="578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a" Jul 20 20:44:59.088170 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:44:59.088153 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a\": container with ID starting with 578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a not found: ID does not exist" containerID="578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a" Jul 20 20:44:59.088218 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.088179 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a"} err="failed to get container status \"578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a\": rpc error: code = NotFound desc = could not find container \"578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a\": container with ID starting with 578dc3df93d556858aef5a72ddaedb32190cb99e0217b2693ba18ab89a4aca8a not found: ID does not exist" Jul 20 20:44:59.098455 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.098434 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l"] Jul 20 20:44:59.101930 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:44:59.101911 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b15c6d-69fbcb8788-z572l"] Jul 20 20:45:00.362042 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:00.362000 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="352879a8-bb94-4ab9-b444-e46156a04ea8" path="/var/lib/kubelet/pods/352879a8-bb94-4ab9-b444-e46156a04ea8/volumes" Jul 20 20:45:00.928696 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:00.928663 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:45:03.277209 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:03.277170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:03.418648 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:03.418590 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:09.428385 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:09.428352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:09.570868 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:09.570831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:09.727851 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:09.727780 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:09.976522 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:09.976489 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:10.604121 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:10.604074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:10.704554 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:10.704517 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:20.708422 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:20.708389 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57"] Jul 20 20:45:20.708938 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:20.708588 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" podUID="f360363e-2623-4a83-88a2-02fd6d299910" containerName="maas-api" containerID="cri-o://328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645" gracePeriod=30 Jul 20 20:45:20.741765 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:20.741698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:20.964174 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:20.964124 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:45:21.087251 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.087218 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls\") pod \"f360363e-2623-4a83-88a2-02fd6d299910\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " Jul 20 20:45:21.087395 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.087297 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f360363e-2623-4a83-88a2-02fd6d299910-openshift-service-ca\") pod \"f360363e-2623-4a83-88a2-02fd6d299910\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " Jul 20 20:45:21.087395 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.087353 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bjnj\" (UniqueName: \"kubernetes.io/projected/f360363e-2623-4a83-88a2-02fd6d299910-kube-api-access-9bjnj\") pod \"f360363e-2623-4a83-88a2-02fd6d299910\" (UID: \"f360363e-2623-4a83-88a2-02fd6d299910\") " Jul 20 20:45:21.087700 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.087670 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f360363e-2623-4a83-88a2-02fd6d299910-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f360363e-2623-4a83-88a2-02fd6d299910" (UID: "f360363e-2623-4a83-88a2-02fd6d299910"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:45:21.089503 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.089484 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f360363e-2623-4a83-88a2-02fd6d299910-kube-api-access-9bjnj" (OuterVolumeSpecName: "kube-api-access-9bjnj") pod "f360363e-2623-4a83-88a2-02fd6d299910" (UID: "f360363e-2623-4a83-88a2-02fd6d299910"). InnerVolumeSpecName "kube-api-access-9bjnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:45:21.089590 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.089573 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f360363e-2623-4a83-88a2-02fd6d299910" (UID: "f360363e-2623-4a83-88a2-02fd6d299910"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 20:45:21.183819 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.183785 2559 generic.go:356] "Generic (PLEG): container finished" podID="f360363e-2623-4a83-88a2-02fd6d299910" containerID="328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645" exitCode=0 Jul 20 20:45:21.183977 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.183831 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" Jul 20 20:45:21.183977 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.183840 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" event={"ID":"f360363e-2623-4a83-88a2-02fd6d299910","Type":"ContainerDied","Data":"328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645"} Jul 20 20:45:21.183977 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.183894 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57" event={"ID":"f360363e-2623-4a83-88a2-02fd6d299910","Type":"ContainerDied","Data":"8806763ce672b7f9eae4c67b0832be5436cda5fc90709b9bfc807f6694efbe37"} Jul 20 20:45:21.183977 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.183923 2559 scope.go:117] "RemoveContainer" containerID="328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645" Jul 20 20:45:21.188054 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.188037 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f360363e-2623-4a83-88a2-02fd6d299910-openshift-service-ca\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:21.188054 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.188056 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bjnj\" (UniqueName: \"kubernetes.io/projected/f360363e-2623-4a83-88a2-02fd6d299910-kube-api-access-9bjnj\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:21.188186 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.188066 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f360363e-2623-4a83-88a2-02fd6d299910-maas-api-tls\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:21.194841 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.194824 2559 scope.go:117] "RemoveContainer" containerID="328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645" Jul 20 20:45:21.195166 ip-10-0-132-157 kubenswrapper[2559]: E0720 20:45:21.195147 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645\": container with ID starting with 328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645 not found: ID does not exist" containerID="328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645" Jul 20 20:45:21.195239 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.195173 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645"} err="failed to get container status \"328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645\": rpc error: code = NotFound desc = could not find container \"328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645\": container with ID starting with 328ea7d058571cc6758e0cba859d5dc3edefe83e168d0c74ab27741891fb4645 not found: ID does not exist" Jul 20 20:45:21.208157 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.208137 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57"] Jul 20 20:45:21.211942 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:21.211922 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-40065f-6bf98777cc-57k57"] Jul 20 20:45:22.367547 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:22.367513 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f360363e-2623-4a83-88a2-02fd6d299910" path="/var/lib/kubelet/pods/f360363e-2623-4a83-88a2-02fd6d299910/volumes" Jul 20 20:45:23.449985 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:23.449950 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54jhs"] Jul 20 20:45:25.235393 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:25.235351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:25.587710 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:25.587621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:31.792695 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:31.792655 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:31.893904 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:31.893861 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:32.058534 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:32.058461 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd"] Jul 20 20:45:32.058694 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:32.058668 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" containerID="cri-o://4d6b2270c88229470740bc111d90ba1e04d36a05ba1f2b17bd2daece18dad31b" gracePeriod=30 Jul 20 20:45:32.082706 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:32.082668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:32.302326 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:32.302282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:35.990243 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:35.990210 2559 patch_prober.go:28] interesting pod/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 20:45:35.990607 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:35.990265 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 20:45:37.263879 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.263850 2559 generic.go:356] "Generic (PLEG): container finished" podID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerID="4d6b2270c88229470740bc111d90ba1e04d36a05ba1f2b17bd2daece18dad31b" exitCode=0 Jul 20 20:45:37.264279 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.263901 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" event={"ID":"55c2237e-3a67-4186-b5ce-fc9228aa8268","Type":"ContainerDied","Data":"4d6b2270c88229470740bc111d90ba1e04d36a05ba1f2b17bd2daece18dad31b"} Jul 20 20:45:37.264279 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.263961 2559 scope.go:117] "RemoveContainer" containerID="5384ec265e069820dfb70fab2983261e954ffe0e40f279ee08d325f79fd21d19" Jul 20 20:45:37.304080 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.304059 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:45:37.419435 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419408 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-envoy\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419593 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419474 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhvrj\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-kube-api-access-qhvrj\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419593 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419505 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-credential-socket\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419593 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419533 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-socket\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419593 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419549 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-token\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419593 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419580 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-podinfo\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419801 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419612 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c2237e-3a67-4186-b5ce-fc9228aa8268-istiod-ca-cert\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419801 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419648 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-certs\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419801 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419677 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-data\") pod \"55c2237e-3a67-4186-b5ce-fc9228aa8268\" (UID: \"55c2237e-3a67-4186-b5ce-fc9228aa8268\") " Jul 20 20:45:37.419801 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419776 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:45:37.420006 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419803 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:45:37.420006 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419967 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-credential-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.420006 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.419985 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-socket\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.420172 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.420086 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c2237e-3a67-4186-b5ce-fc9228aa8268-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 20:45:37.420475 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.420451 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:45:37.420840 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.420810 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-data" (OuterVolumeSpecName: "istio-data") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:45:37.421839 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.421813 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 20:45:37.421921 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.421883 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-token" (OuterVolumeSpecName: "istio-token") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:45:37.421921 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.421894 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-kube-api-access-qhvrj" (OuterVolumeSpecName: "kube-api-access-qhvrj") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "kube-api-access-qhvrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 20:45:37.422135 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.422120 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55c2237e-3a67-4186-b5ce-fc9228aa8268" (UID: "55c2237e-3a67-4186-b5ce-fc9228aa8268"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 20:45:37.520815 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.520784 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-token\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.520815 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.520812 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-podinfo\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.520815 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.520821 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c2237e-3a67-4186-b5ce-fc9228aa8268-istiod-ca-cert\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.521009 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.520829 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-workload-certs\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.521009 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.520837 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-data\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.521009 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.520844 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c2237e-3a67-4186-b5ce-fc9228aa8268-istio-envoy\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:37.521009 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:37.520851 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhvrj\" (UniqueName: \"kubernetes.io/projected/55c2237e-3a67-4186-b5ce-fc9228aa8268-kube-api-access-qhvrj\") on node \"ip-10-0-132-157.ec2.internal\" DevicePath \"\"" Jul 20 20:45:38.270366 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:38.270329 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" Jul 20 20:45:38.270366 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:38.270341 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd" event={"ID":"55c2237e-3a67-4186-b5ce-fc9228aa8268","Type":"ContainerDied","Data":"15b26310a6c04bf3185dd0ca3f45f756be9761e387e1a11d91f1efd25c0bd5fb"} Jul 20 20:45:38.270840 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:38.270407 2559 scope.go:117] "RemoveContainer" containerID="4d6b2270c88229470740bc111d90ba1e04d36a05ba1f2b17bd2daece18dad31b" Jul 20 20:45:38.293456 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:38.293429 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd"] Jul 20 20:45:38.297111 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:38.297091 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-40065f-openshift-default-77888bccbc-n9prd"] Jul 20 20:45:38.362371 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:38.362334 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" path="/var/lib/kubelet/pods/55c2237e-3a67-4186-b5ce-fc9228aa8268/volumes" Jul 20 20:45:39.066535 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:39.066510 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-t7z7x_b110ce57-5731-4bcd-8628-9a02d1ba84d5/copy-manifests/0.log" Jul 20 20:45:39.083122 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:39.083098 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-t7z7x_b110ce57-5731-4bcd-8628-9a02d1ba84d5/manager/0.log" Jul 20 20:45:42.102707 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:42.102681 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-54jhs_d56f3044-e269-4591-8b60-5b18990c73b7/limitador/0.log" Jul 20 20:45:42.597884 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:42.597852 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jrpd8_059e6526-1b2e-4db2-9f3c-b249ed485471/istio-proxy/0.log" Jul 20 20:45:42.733465 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:42.733436 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qtdcx_304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e/discovery/0.log" Jul 20 20:45:43.094446 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:43.094419 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fp59r_76b4c9e7-a5d8-42a8-8789-92cb75daba7e/istio-proxy/1.log" Jul 20 20:45:44.242375 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:44.242324 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tzjbb_8c7d273e-e680-49c6-bf14-dc4b00d17a88/main/0.log" Jul 20 20:45:50.201992 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:50.201958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:50.272312 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:50.272286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:45:53.263925 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:53.263853 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kp69t_7ff151a4-5119-4434-8578-6a1801e3db65/global-pull-secret-syncer/0.log" Jul 20 20:45:53.364451 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:53.364397 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" Jul 20 20:45:53.479680 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:53.479657 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-157.ec2.internal_67ecf77339d42dd20887080fc19e8000/haproxy/0.log" Jul 20 20:45:58.827492 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:45:58.827419 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-54jhs_d56f3044-e269-4591-8b60-5b18990c73b7/limitador/0.log" Jul 20 20:46:00.488179 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.488142 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980/alertmanager/0.log" Jul 20 20:46:00.515210 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.515178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980/config-reloader/0.log" Jul 20 20:46:00.542231 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.542206 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980/kube-rbac-proxy-web/0.log" Jul 20 20:46:00.562876 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.562856 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980/kube-rbac-proxy/0.log" Jul 20 20:46:00.584544 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.584517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980/kube-rbac-proxy-metric/0.log" Jul 20 20:46:00.604196 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.604176 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980/prom-label-proxy/0.log" Jul 20 20:46:00.632931 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.632914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_686c7b8d-e7f4-46bf-bcb0-4ad0a2e27980/init-config-reloader/0.log" Jul 20 20:46:00.704875 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.704854 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-ggwtb_497b841b-8b1a-4d82-a96e-763a5bc16c73/kube-state-metrics/0.log" Jul 20 20:46:00.722704 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.722678 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-ggwtb_497b841b-8b1a-4d82-a96e-763a5bc16c73/kube-rbac-proxy-main/0.log" Jul 20 20:46:00.742471 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.742454 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-ggwtb_497b841b-8b1a-4d82-a96e-763a5bc16c73/kube-rbac-proxy-self/0.log" Jul 20 20:46:00.770379 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.770355 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9b69c9676-dtxg4_d33f9822-a6ec-4e4f-9b86-3f88555e3b93/metrics-server/0.log" Jul 20 20:46:00.793963 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:00.793942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-qf9mx_8663eed9-4611-45fa-b229-23887d938171/monitoring-plugin/0.log" Jul 20 20:46:01.001726 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.001636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6mz9_e74400ff-08ba-4375-b151-4e1f2f64f273/node-exporter/0.log" Jul 20 20:46:01.023246 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.023221 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6mz9_e74400ff-08ba-4375-b151-4e1f2f64f273/kube-rbac-proxy/0.log" Jul 20 20:46:01.044148 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.044128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q6mz9_e74400ff-08ba-4375-b151-4e1f2f64f273/init-textfile/0.log" Jul 20 20:46:01.073861 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.073839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ffgcq_5dd93501-5fca-4e39-97f2-0a1e1b3fd18c/kube-rbac-proxy-main/0.log" Jul 20 20:46:01.097910 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.097885 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ffgcq_5dd93501-5fca-4e39-97f2-0a1e1b3fd18c/kube-rbac-proxy-self/0.log" Jul 20 20:46:01.117980 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.117957 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ffgcq_5dd93501-5fca-4e39-97f2-0a1e1b3fd18c/openshift-state-metrics/0.log" Jul 20 20:46:01.185581 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.185557 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543e1a78-76d0-4baf-b4d0-bd0e6e558483/prometheus/0.log" Jul 20 20:46:01.205074 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.205053 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543e1a78-76d0-4baf-b4d0-bd0e6e558483/config-reloader/0.log" Jul 20 20:46:01.228169 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.228150 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543e1a78-76d0-4baf-b4d0-bd0e6e558483/thanos-sidecar/0.log" Jul 20 20:46:01.248213 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.248193 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543e1a78-76d0-4baf-b4d0-bd0e6e558483/kube-rbac-proxy-web/0.log" Jul 20 20:46:01.272334 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.272275 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543e1a78-76d0-4baf-b4d0-bd0e6e558483/kube-rbac-proxy/0.log" Jul 20 20:46:01.294567 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.294542 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543e1a78-76d0-4baf-b4d0-bd0e6e558483/kube-rbac-proxy-thanos/0.log" Jul 20 20:46:01.317277 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.317257 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_543e1a78-76d0-4baf-b4d0-bd0e6e558483/init-config-reloader/0.log" Jul 20 20:46:01.347691 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.347667 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ml7mh_e3401588-45a4-4a09-94b4-4c4bdf47e006/prometheus-operator/0.log" Jul 20 20:46:01.363491 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.363472 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ml7mh_e3401588-45a4-4a09-94b4-4c4bdf47e006/kube-rbac-proxy/0.log" Jul 20 20:46:01.387628 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.387606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-jqcgj_e3287f3b-95d3-4e97-ae29-b23bd27baed4/prometheus-operator-admission-webhook/0.log" Jul 20 20:46:01.480721 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.480700 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7885567-5ksx8_ecfce70d-db11-4f8e-81a8-a178953071f7/thanos-query/0.log" Jul 20 20:46:01.498625 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.498606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7885567-5ksx8_ecfce70d-db11-4f8e-81a8-a178953071f7/kube-rbac-proxy-web/0.log" Jul 20 20:46:01.516423 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.516388 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7885567-5ksx8_ecfce70d-db11-4f8e-81a8-a178953071f7/kube-rbac-proxy/0.log" Jul 20 20:46:01.535047 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.534966 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7885567-5ksx8_ecfce70d-db11-4f8e-81a8-a178953071f7/prom-label-proxy/0.log" Jul 20 20:46:01.553740 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.553722 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7885567-5ksx8_ecfce70d-db11-4f8e-81a8-a178953071f7/kube-rbac-proxy-rules/0.log" Jul 20 20:46:01.582839 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:01.582815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7885567-5ksx8_ecfce70d-db11-4f8e-81a8-a178953071f7/kube-rbac-proxy-metrics/0.log" Jul 20 20:46:02.932630 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932595 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs"] Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932943 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f360363e-2623-4a83-88a2-02fd6d299910" containerName="maas-api" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932953 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f360363e-2623-4a83-88a2-02fd6d299910" containerName="maas-api" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932968 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932973 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932981 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352879a8-bb94-4ab9-b444-e46156a04ea8" containerName="maas-api" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932987 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="352879a8-bb94-4ab9-b444-e46156a04ea8" containerName="maas-api" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.932995 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.933001 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.933075 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c2237e-3a67-4186-b5ce-fc9228aa8268" containerName="istio-proxy" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.933084 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f360363e-2623-4a83-88a2-02fd6d299910" containerName="maas-api" Jul 20 20:46:02.933107 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.933090 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="352879a8-bb94-4ab9-b444-e46156a04ea8" containerName="maas-api" Jul 20 20:46:02.936180 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.936164 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:02.938295 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.938275 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7mjff\"/\"openshift-service-ca.crt\"" Jul 20 20:46:02.938410 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.938286 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7mjff\"/\"kube-root-ca.crt\"" Jul 20 20:46:02.938967 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.938950 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7mjff\"/\"default-dockercfg-frpwq\"" Jul 20 20:46:02.945774 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:02.945748 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs"] Jul 20 20:46:03.032765 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.032735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-sys\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.032933 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.032807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s56r5\" (UniqueName: \"kubernetes.io/projected/da051225-627e-4356-858d-81899bd5ab70-kube-api-access-s56r5\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.032933 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.032897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-proc\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.033052 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.032948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-lib-modules\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.033052 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.032969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-podres\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134233 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-sys\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134233 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s56r5\" (UniqueName: \"kubernetes.io/projected/da051225-627e-4356-858d-81899bd5ab70-kube-api-access-s56r5\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134466 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-proc\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134466 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-lib-modules\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134466 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134328 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-sys\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134466 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-podres\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134466 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134419 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-proc\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134466 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-podres\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.134679 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.134491 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da051225-627e-4356-858d-81899bd5ab70-lib-modules\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.141767 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.141743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s56r5\" (UniqueName: \"kubernetes.io/projected/da051225-627e-4356-858d-81899bd5ab70-kube-api-access-s56r5\") pod \"perf-node-gather-daemonset-mhkhs\" (UID: \"da051225-627e-4356-858d-81899bd5ab70\") " pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.248097 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.248009 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:03.380868 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.380839 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs"] Jul 20 20:46:03.383129 ip-10-0-132-157 kubenswrapper[2559]: W0720 20:46:03.383098 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda051225_627e_4356_858d_81899bd5ab70.slice/crio-23c19f0f21271cd4d4b2e756c7c458b3f908ad233cd471995e9b6cc026dccbaa WatchSource:0}: Error finding container 23c19f0f21271cd4d4b2e756c7c458b3f908ad233cd471995e9b6cc026dccbaa: Status 404 returned error can't find the container with id 23c19f0f21271cd4d4b2e756c7c458b3f908ad233cd471995e9b6cc026dccbaa Jul 20 20:46:03.909231 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:03.909206 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65569c5f5-cklwp_c41d3af2-a755-444b-a96b-6f3063eb2892/console/0.log" Jul 20 20:46:04.390722 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:04.390688 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" event={"ID":"da051225-627e-4356-858d-81899bd5ab70","Type":"ContainerStarted","Data":"d59bfddfecd0b21ef6a8a9244df7a859896b328b4c44402c2ed9d72c16da79f8"} Jul 20 20:46:04.391175 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:04.390748 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" event={"ID":"da051225-627e-4356-858d-81899bd5ab70","Type":"ContainerStarted","Data":"23c19f0f21271cd4d4b2e756c7c458b3f908ad233cd471995e9b6cc026dccbaa"} Jul 20 20:46:04.391175 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:04.390814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:04.405682 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:04.405633 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" podStartSLOduration=2.405617972 podStartE2EDuration="2.405617972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:46:04.404800224 +0000 UTC m=+2972.588647954" watchObservedRunningTime="2026-07-20 20:46:04.405617972 +0000 UTC m=+2972.589465704" Jul 20 20:46:04.630476 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:04.630426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:46:04.686066 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:04.685960 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:46:05.630811 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:05.630778 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64wmx_2019a249-ea10-4064-bd63-8186391c8632/dns/0.log" Jul 20 20:46:05.651255 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:05.651220 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-64wmx_2019a249-ea10-4064-bd63-8186391c8632/kube-rbac-proxy/0.log" Jul 20 20:46:05.809521 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:05.809489 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhzlb_e9996674-dea2-4863-95c9-9a2ec29548a4/dns-node-resolver/0.log" Jul 20 20:46:06.357553 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:06.357530 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ccvzj_4b62ac2e-19b2-4b50-973c-4dbc2b56c72f/node-ca/0.log" Jul 20 20:46:07.318052 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:07.318004 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jrpd8_059e6526-1b2e-4db2-9f3c-b249ed485471/istio-proxy/0.log" Jul 20 20:46:07.540447 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:07.540418 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qtdcx_304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e/discovery/0.log" Jul 20 20:46:07.626175 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:07.626091 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fp59r_76b4c9e7-a5d8-42a8-8789-92cb75daba7e/istio-proxy/0.log" Jul 20 20:46:07.677914 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:07.677884 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fp59r_76b4c9e7-a5d8-42a8-8789-92cb75daba7e/istio-proxy/1.log" Jul 20 20:46:08.427215 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:08.427182 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-df59t_e80fb783-f266-4599-beb7-fd4708fe0fae/serve-healthcheck-canary/0.log" Jul 20 20:46:08.981831 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:08.981795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m4ncs_d80347be-45ae-4f36-8930-395b487af755/konnectivity-agent/0.log" limit=1024 Jul 20 20:46:08.997208 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:08.997186 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nnr2_bf65d6bd-1f97-4528-9f3d-1cc7119be8b4/kube-rbac-proxy/0.log" Jul 20 20:46:09.020921 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:09.020891 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nnr2_bf65d6bd-1f97-4528-9f3d-1cc7119be8b4/exporter/0.log" Jul 20 20:46:09.043596 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:09.043576 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nnr2_bf65d6bd-1f97-4528-9f3d-1cc7119be8b4/extractor/0.log" Jul 20 20:46:10.404916 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:10.404882 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7mjff/perf-node-gather-daemonset-mhkhs" Jul 20 20:46:12.039950 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:12.039922 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-t7z7x_b110ce57-5731-4bcd-8628-9a02d1ba84d5/manager/0.log" Jul 20 20:46:12.065187 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:12.065114 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cb6d7555-t7z7x_b110ce57-5731-4bcd-8628-9a02d1ba84d5/copy-manifests/0.log" Jul 20 20:46:13.319431 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:13.319337 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jrpd8_059e6526-1b2e-4db2-9f3c-b249ed485471/istio-proxy/0.log" Jul 20 20:46:13.444267 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:13.444239 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f6758cc7d-cxm7g_9936e923-1633-40af-9c33-5b5dbdc88c0a/manager/0.log" Jul 20 20:46:13.494109 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:13.494086 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jdzhk_2f20a51f-7900-4170-a96e-0baae26fdb2f/openshift-lws-operator/0.log" Jul 20 20:46:13.536660 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:13.536633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qtdcx_304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e/discovery/0.log" Jul 20 20:46:13.586677 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:13.586602 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fp59r_76b4c9e7-a5d8-42a8-8789-92cb75daba7e/istio-proxy/0.log" Jul 20 20:46:13.638377 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:13.638349 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fp59r_76b4c9e7-a5d8-42a8-8789-92cb75daba7e/istio-proxy/1.log" Jul 20 20:46:14.913508 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:14.913485 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jrpd8_059e6526-1b2e-4db2-9f3c-b249ed485471/istio-proxy/0.log" Jul 20 20:46:15.131275 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:15.131242 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qtdcx_304d84ae-3d6e-44c1-ad8f-06d6f5c8d67e/discovery/0.log" Jul 20 20:46:15.188843 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:15.188738 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fp59r_76b4c9e7-a5d8-42a8-8789-92cb75daba7e/istio-proxy/0.log" Jul 20 20:46:15.239327 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:15.239293 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fp59r_76b4c9e7-a5d8-42a8-8789-92cb75daba7e/istio-proxy/1.log" Jul 20 20:46:19.911670 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:19.911637 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2lbnh_8d037ade-1fb7-42e6-b2f0-aab28b85567b/kube-multus/0.log" Jul 20 20:46:20.101545 ip-10-0-132-157 kubenswrapper[2559]: I0720 20:46:20.101513 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ldbtp_bc966792-b9a2-459f-a269-fa9289367373/kube-multus-additional-cni-plugins/0.log"